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¢ concluded that standardized tests would greatly help 
the conditions set forth in my first article, I next at- 


he problem of securing the whole-hearted cooperation of my 


in their use. The psychology of interest teaches us that 
erson’s best efforts are called forth only when he feels a real 
So I set myself to arouse in my teachers an enthusiastic 
rest by bringing them to feel a real need for definite standards 
omplishment in school work. In order to make them feel 

| deeply, something more than merely telling them of the 

| their uses was necessary. They must be made to realize 


dequacy of ordinary methods of measuring results of 


rdingly, I called a series of teachers’ meetings on four con- 
tive Saturday afternoons. In a district more than twenty 
s square it is not easy to get all the teachers together at one 
I succeeded, however, in persuading two automobile own- 
1 each town to take the teachers to these four meetings at a 
that would little more than pay for the gasoline consumed. 
ther or not this scheme could be worked in other districts 
id depend, of course, on the character of the automobile 
rs and the success of the superintendent in convincing them 
they ought to be willing to do it in an emergency and for the 


ire of the schools. 
t the first meeting I outlined briefly what I wanted to do and 


and then suggested that we try some practical experiments. : 
al 
sis the second article by Superintendent Brooks on the general topic “Putting 
rdized Tests to Practical Use in Rural Schools.” 
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The first experiment was intended to prove the ina 


teachers’ marks in general 


peper turned in by a sixtl 
test given by one of the 
ten problems and was supp« 
age. A hektographed copy 


each of the 24 teachers. 


teachers. 
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RST MEETING 

A tew days before I had se}, 
i-grade pupil in a regular 
This test contain 
sed to measure knowledge: 

of the pupil’s paper was g] 


Then, without warning ther 


purpose or of what the results were apt to be, I asked 


correct the paper and mark it on a percentage basis. \W 


had finished, the papers we 
the results on the blackboar 


TABLE I. DISTRIBUTIO 


ARIT 


Rati 


90-94 


The effect was striking 


idea and the expressions on the various faces showed me t! 
by pointing out the moral. Ai 


was no need of rubbing it in 
interest was evident as I pi 
gestion that we analyze the 
factors which produced su¢ 
finally agreed on the followir 


1. Most had marked the pup 


‘re collected and I at once t 
d with the result shown in 7 


N OF RATINGS OF A SIXTH-G! 


HMETIC PAPER 
~ Ir 

6 

| 


Nearly everybody had caut 


issed the papers back with tl 
methods of marking to disco’ 
h evident lack of agreement 
ig points: 


iS response to a problem entire 


the answer was wrong without regard to correctness princip 

2. Some gave half credit if the principle was right and the 

3. The majority marked answers entirely wrong if a de 
omitted or splaced while some gave varying degre f cred 
of the nswe vere correct and the decimal point I spl 1 o1 

} \ fe v | id ssigne 1 weights to he var ) s problems o tl ! 
own judgments with far from uniform results Chis factor 


to have been the one whi h ha | Dp 


marking 


: ~ 

70-74 
65-69 
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[hen someone suggested that we try it again and see if we 
ildn’t do better Several others seconded the idea, so I pass¢ d 
id copies of an eighth-grade pupil’s history paper. Never 
teachers work more seriously than did those teachers for the 
xt fifteen or twenty minutes. The papers were then collected 
| the marks tabulated as before with these results: 


rABLE Il. DISTRIBUTION OF RATINGS OF AN EIGHTH-GRADI 
HISTORY PAPER 


Ratings Frequency 
On 4 1 
RO-S4 10 
75-79 
70-74 2 
65-69 


Then followed a lively discussion, as a result of which the fol 
owing important conclusions were unanimously agreed upon: 


1. That teachers’ marks are ordinarily very apt to be inaccurate 
2. That, due to the personal standards of the teacher and to individu 
g svstem$S, the work of the same child may be graded very high bv one 


her and very low by another 

3. That such irresponsible rating may work serious injustice to the 

lren 

4. That the work of different schools cannot be accurately compared 
der such conditions 

And best of all, these conclusions were mostly arrived at by the 
teachers themselves with the help of a few leading questions on my 
part. Wasit worth while? Would those teachers ever again cor- 
rect test papers with the same self-satisfied assurance of the infal- 
lible justice of their marks? Would they ever again feel fully 
justified in retarding a pupil because he is given a mark of 68 when 
the passing mark is 70? 

It was now time to bring the meeting to a close. Several 
wanted to know what better method of marking could be found. 
I advised all who were interested in solving the problem to order 
at once Monroe’s book, ‘Measuring the Results of Teaching,’” 
and to think the matter over until our next meeting. 


*? Monroe, Walter S., Measuring the Results of T 
Mifflin Company, 1918. 


\ 
Me +: 
a 

| : 
a 

7 
q 

* 

£ 

} 


128 JOURNAL EDUCATIONAL RESEARCH Vol. 2, No. I 


THE SECOND MEETING 
In preparation for the next meeting I made a list of twelve his- 
tory questions on the events leading up to the American Revolu- 


tion Che questions were as follows: 
ide for e col 
\\ had he « lonies 
How w he commerce of the colonies regulated 
\\ t 1 ot a king was George III? 
5 Wi is the Stamp Act? 
a) What were the objections to it? 
7. What was the Stamp Act Congress and what did it do 
[tow did the British try to keep the colonists in order? 
9. What friends had the colonists in Great Britain? j 
10 Wi is the Act of Associatio 
11 Hi was it enforced? 


12. Distinguish between the real and the apparent reasons for the 
Revolution 

When we were again assembled I passed two copies of this list 
to each teacher with the request that they rank the questions one, 
two, three, etc., in the order of their difficulty beginning with the 
easiest, and that they write these ranks opposite the questions on 
one of the papers which they had received. When they had 
tinished, I asked each teacher to read the ranks she had assigned 
to the questions beginning with question one, while I tabulated 
them on the board in such a way that vertical columns would show 


the various ranks assigned to the same question and horizontal 


rows the ranks assigned to all the questions by each teacher. I 
regret that I have lost my copy of the original table, but the gen 
eral arrangement (for four teachers only) is shown below without 


the correct higures 


Preacher Rank Assigned to Each Indicated Question 
2 4 > | 6 9 10 11 12 

— 
\ 6 } ) 7 9 12 3 8 5 | 1 10 11 
7/1] 3] 9} 10] 4/6/12] 8] 1 
D 12] 4 6/ 9] 11] 7 2] 12 3 


This tabulation showed such wide variations in the ranks 
assigned to the same question by different teachers, that a lively 


= 
| 
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interest was aroused. In the ensuing discussion further conclu- 
sions were reached which may be summed up as follows: 


1. That if a test is to measure accurately a pupil’s knowledge of the 
ground ¢ yvered, the questions must be so selected as to bring ou he 
ideas in the subject matter 
2. That there should be a large proportion of thought questions in ordet 
| for something more than a parrot-like repetition of memorized facts 


the better students may be enabled to demonstrate their superiot 
ning abilities 
3. That some accurate method of weighting the questions must be used 
uccurate measurement of pupils’ abilities and knowledge are to be expected 
$. That the weighting of questions by individual teachers on the bas 
heir personal judgments is mere guesswork since, as was shown by our 
experiment, they cannot even judge accurately the relative difficulty of 
estions. 
5. That the average of the judgments of a number of teachers is apt to be 


ore accurate than the judgment of a single one 


In line with this last conclusion we then proceeded to find the 
the average rank assigned each question and, with these averages 
as a basis, torank the questions according to their relative difficulty 
as determined by the combined judgments of the teachers. Next 
I asked them to use these ranks as a guide and to assign values to 
each question so that the sum of the values would equal one hun 
dred. It was observed that for each question the variations in 
values were not as wide as the variations in ranks had been. This 
was attributed to the fact that the order of difficulty used as a 
guide and the limit of one hundred placed on the sum of the values 
would necessarily permit much less variation. The results are 
shown in Table IIL. 

The lesson of the day had been so well assimilated that someone 
suggested that since the ranking of the questions by each individ 
ual was all guesswork as proved by our experiment, then our aver- 
ages were only averages of guesswork and hence likely to be far 
from reliable. For her part she did not see that we had any real 
proof that question twelve for instance was any harder than 
question three, and more than that she didn’t see how we were 
going to prove that it was. Then came what I was hoping for but 
hardly expected. 

“The eighth grades have recently completed their study of the 
period of history which the questions cover. Why not give them 
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rABLE III, WEIGHTS ASSIGNED TO TWELVE HISTORY QUESTIONS 


ACCORDING TO TEACHERS’ JUDGMENTS 


\ 
0) | 
N I \ 

1 10 
; 12 
} l l 
7 9 
6 
10 1! 14 
11 10 13 

12 12 i7 Total 100 


as a test to these grades and so tind out which questions are 
hardest?” This from a bright girl who had attended one summer 
session at Plymouth Normal. 

“How could you prove which questions are hardest by doing 
that?” I asked 

“Why, if the questions were given to a large number of pupils, 
would it not be safe to conclude that the one which is missed the 
most times is hardest and that the one missed the next largest 
number of times is the next hardest, and so on?” 

he practical side of this suggestion appealed to the majority 
of the teachers at once and they were eager to try it. Since this 
was the very thing I had intended to propose in order to get 
material for discussion at our next meeting, you may be sure that 
I was not slow in taking advantage of their enthusiasm. So it was 
decided to give this list of questions as a history test to all the 
eighth-grade pupils in the district. The teachers were to bring 
the corrected papers with them to the next meeting. 

THe MEETING 
[ watched the faces of the teachers as they gathered for our 


third meeting. The dazed look had passed from most of them by 
this time and a look of intelligent comprehension was taking its 
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lhe books which they had ordered at my request had 
| during the week and they had been reading them. They 
pparently beginning to get their bearings. There was a 
like air in the way they took their seats and prepared 
fternoon’s work that augured well for the future 
eeting having been called to order we began to investigate 
results of the history test. It had been given to 106 pupils. 
\s I called a question by number, each teacher told me how many 
s her pupils had missed it. I wrote the figures on the board, 
column for each question. When the results had all been read 
were summed and tabulated as in Table IV. 


LE IV. RANK OF HISTORY QUESTIONS IN DIFFICULTY, BASED ON 
NUMBER OF TIMES MISSED 


N ] } 6 7 & ) 10 11 12 
28 44 1) ) 5 56 51 
1 ; 7 6 2 12 11 10 


his table shows that question four is easiest since it was missed 
least number of times and that question ten is hardest since 
was missed the greatest number of times. Also, that question 
n is seven and a half times as hard as question four because it 
; missed seven and a half times as often.* This would indicate 
it, in weighting the questions, number ten should be valued 
seven and a half times as much as number four. When these 
ints had been discussed, even the teacher who was dissatisfied 
t our last meeting was convinced that we had found a fairly 
curate method of evaluating questions. 
Che next step was to find values for the questions according to 
their relative difficulties. We first assigned to the easiest question 
number four), which was missed eight times, a value of one. Since 
the next question in order of difficulty (number nine) was missed 
sixteen times, or just twice as often as number four, we gave it a 
value of two. Question six was missed twenty times. As twenty 
s two and a half times eight, this question was valued two and a 
half. The same method was followed throughout. 


3 Statistical difficulties involving the location of the zero point were ignored 
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The sum of these values was found to be 51.5. Since the su; 
of the teachers’ estimated values (Table III) was one hundred. j; 
was necessary for comparative purposes that the sum of thes 
values should also be one hundred. Evidently if each of the: 
were multiplied by two, the sum of the resulting proportionat 
values would be 103. This was near enough to one hundred { 
our purposes and it had the advantage of yielding whole numbers 
These may be seen in the last column of Table V, which summar 
izes the results of our study of the history questions. 


TABLE V SUMMARY OF RANKS AND VALUES FOR EACH OF TWELY! 
HISTORY QUESTIONS 


(Questh Estimated Real limes Estimated Derived rhe Sa 
No. Rank Rank Missed Value Value Mult 
| 8 5 28 10 3.5 7 
2 9 14 11 
y 40 12 5.0 10 
8 1 1.0 2 
i 23 9 3.0 
5 20 7 25 5 
7 35 2 +5 
\ ( 6 29 8 3 5 7 
Y 2 16 3 2.0 4 
10 11 12 60 | 14 a 15 
11 10 11 56 13 7.0 14 
1 12 10 51 17 6.5 13 


After the teachers had rated a few history papers using the two 
sets of values, we concluded our experiments. Crude and inaccu- 
rate they were, of course; but they were not intended to contribute 
to the statistics of educational measurements. They were rather 
designed to exemplify to the teachers that spirit of scientific 
investigation which is so rapidly making over our school system, 
and in particular to convince them that teachers’ ratings as 
ordinarily made are unreliable. And they had served well. All 
but two or three of the teachers had by this time expressed their 
firm conviction that tests devised by teachers and rated according 
to individual standards are of little use in finding out a pupil’s rea! 
knowledge or ability, or in determining his standing with regard 
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to other pupils of his age and grade. These two or three teachers 
no amount of accumulated evidence could convince, because 
everything was unalterably settled to their way of thinking before 


the experiments were tried. The old methods had been in use for 


undreds of years and must, therefore, be better than anything 
w. It is useless to waste time with such peopl Phe on 


ing to do is to get rid of them at the first opportunity 

A tew more points were cleared up by gen ral discussion 
Someone objected that, with a passing mark of seventy, it was 
evident from the scores that two-thirds of the pupils would fail 
to pass the test. This brought up an important point. Is it fair 
to mark pupils on a percentage basis with 100 standing for per 
fection? Some thought it was. Some thought it wasn’t. Most 
hadn’t thought about it, but since the matter was called to their 
attention they were inclined to think that it was hardly fair 
What fairer way could I suggest? 

[ then explained what is meant by a median score, demonstrated 
with figures on the board the difference between median and 
average, pointed out the advantages of the median, and then 
proposed that we find the median score of the 106 history papers 
using the derived values for marking. ‘This was found to be 65.1 
to which I added 10 percent of itself and suggested that we use the 
result, 71.6, as a standard score. Any child who got this score 
would be given a mark of 100. That is, a pupil’s mark would be 
the percent that his score was of the standard score. For instance 
if pupil A had a score of 26, his mark would be 26 divided by 71.6 
or 36. If pupil B scored 63, his mark would be 63 divided by 
71.6 or 90. A pupil who scored 85 would receive a mark of 118. 
In using letters for marks this pupil would be marked A+. It 
was pretty well agreed that this method of marking would be 
eminently fair, provided standard scores were available. The 
method may not be scientifically accurate; but it is certainly fairer 
than the ordinary method of marking on a percentage basis, and 
it has the advantage of simplicity. 

Then someone wanted to know if we should do away with 
teachers’ tests entirely and depend on the standardized tests 
altogether. We finally decided that teachers’ tests should be 
used often by way of written reviews for the benefit of the pupils, 
but that the results should not have too much weight in determin- 
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ing the pupil’s final standing. The pupils themselves, however 
need not know how much or how little weight these tests might 
have on their grading for promotion 

Most of the st indardized tests which I had ordered were at han 
for this meeting Samples of these were given to the teachers t: 


study in connection with their new books on education il measuré 


ments \iter explaining briefly the painstaking methods em 


inn 


ployed in deriving these tests and scales, I dismissed the meeting 


Fourtu MEETING 


Our tourth meeting was devoted to the actual work of givin 
scoring the tests. A few obvious facts were first emphasized 
such as the need of accurate timing in cases where tim was 

tactor, the fact that no help should be given the pupils other tl in 
clear and complete directions, and the fact that when dire: tions 
act ompank d the tests they should be followed explicitly. [ also 
warned the teachers to beware of copying on the part of pupils; 
and I then proceeded to administer the tests to the teachers just 
as they should be administered in the classroom. As each test 
was finished we corrected and scored it, each teacher correcting 
and scoring her own paper for practice. In this way many 
obscure points were cleared up. Each teacher had seen each test 
given and had herself corrected and scored a sample of each test 
properly. They kept these corrected samples to use as models in 


correcting the tests which they were to give in their schools 
Unless some such precaution is taken beforehand. the superintend 
ent is sure to be surprised and dismayed when he gets the first 
packages of tests from his teachers. He will find that he must 
either return them to the teachers with time-consuming directions 
and explanations or go over most of them himself in order to get 
accurate results. I had been through such experiences before on 
a small scale and intended to avoid them this time as far as 
possible. 

Since the tests were to be given to pupils the following week, 
each teacher then received a sufficient supply for her school. The 
tests were to be corrected and returned to me by mail within ten 
days. Unless a definite time limit is set and stric tly adhered to, 
batches of tests from the various schools will come straggling in for 
two months after they are given out. Thus a few procrastinating 
teachers can delay the superintendent’s part of the work to a 
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innoying extent. In order to tabulate and study results for 
istrict as a whole he must have all his data in hand at one 
und as soon as possible after the tests are given out. In this 
I was particularly anxious to have all the tests in on time as 
erading of the schools was being delayed pending the results. 

so I laid special emphasis on the ten-day limit. 
lhe teachers were further warned that, although I had no 
son to distrust anybody, the matter was too important to per 
taking any chances. Accordingly, I proposed to check the 
k of each teacher by giving one or two of the tests in her school 
r she had given all of them. By comparing the results of my 
sts with theirs of the same kind I could readily detect any gross 
relessness or intentional dishonesty on the part of the teachers 
[here is considerable temptation for some shortsighted teachers 
) know that their own efficiency is being measured by these 
tests, to stretch the time limit or to give illegitimate aid to the 
pils, or even to drill on the test itself, in the effort to make their 
sses show up well. Of course any intelligent teacher, knowing 
w the tests are used, would see the shortsightedness of such a 
licy since it is evident that what might be gained on one test 
ild be lost on the next. However, two or three such dishonest 
hers may, at first, work sad havoc with the accuracy of a 
superintendent’s final figures regarding the efficiency of his schools 
teachers unless he takes some precautions to discover the 
ilprits at the start. Hence my method of checking their work. 
Above all, tests should not be permitted to fall into the hands 
{ pupils. Since they are to be used again and again to measure 


progress, teachers should be impressed with the importance of 
safeguarding them. As fast as the papers are finished they should 
be taken up to prevent possible copying of the questions or prob- 
lems by the pupils in preparation for future tests. Of course, 
this does not apply in the case of the writing, spelling, and composi- 
tion scales because of the different manner in which they are used. 
In fact it is well to display these scales on the walls of the school 


room so that the pupils may try to measure their own work. 

This ends the account of how the cooperation of these teachers 
was secured in the use of standardized tests. It may not be 
intensely interesting in the reading, but it was assuredly interest- 
ing in the doing. Results since have proved its value. I can 
recommend the general procedure to anyone with a similar prob- 
lem to solve. 
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FORMULATION OF METHOD IN READING! 


lhe rapid accumulation of scientific data in education is maki 
possible the formulation of a far more effective educational] pr 
tice than has hitherto existed. In reading this is particular 
true. The physiology and the psychology of reading have bee: 
investigated, so that one can now give a reasonably accurat 
scientific description of the act of reading. How the individy 
recognizes the printed symbols and how he assimilates the cont: nt 
underlying them can be stated with some degree of definiteness 
The results of objective measurements of re ading ability have 
thrown a great deal of light both on the re ading act and the tea 
ing process. In a word, a considerable body of facts has beer 
accumulated in the last few years as the outcome of various types 
of investigations. The result is that we have a body of inform: 


tion sufficient to form the basis of a re asonably valid, scientifi 


procedure in teaching. 

\dvance in teaching reading, however, has not kept pace wit! 
increased knowledge about reading. One sees even in the so-call: 
best schools practices which can in no way be justified in the light 
of present knowledge. I am convinced that there is a very great 
need of a reformulation of practice on a somewhat higher bts int 
[t will do little good to accumulate more data from measurem: 
and investigations until better and wider use has been meg of 
information now at hand. In making these statements, I am not 
unmindful of the great progress which has been made during the 
last ten years, and especially during the last five years, in the 
teaching of reading 

Of course, the limits of this address would preclude a complet: 
discussion and reformulation of procedure in teaching reading 
[t is my purpose, however, to indicate some lines along which this 
reorganization should take place, and to suggest certain definite 
steps in the direction of improved methods of instruction which 
need to be taken immediately, in order to bring practice more 


‘An addre lelivered before the National Association of Directors of Educat 
Research, at Cleveland, Ohio. February 26, 1920. 
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-ly into harmony with the enlarged body of s« ientific informa- 
which has been brought forward by investigators in the last 


Metuop oF APPROACH TO THE PROBLEM 
Che best approach to this problem of the pedagogy of reading 
‘nvolve three distinct lines of investigation. 
he first important step is a study of those fundamental 
eC] sd significant facts of the physiology and psychology of reading, 
throw light upon the processes involved in the act ol 


). From a study of all the known facts at hand in this field, 
ess certain hypotheses or tentative principles of teaching may be 
ave established, and we may then proceed to teach reading in accord 


with the principles thus established. In a word, on the 
en of the data from the physiology and psychology of reading, 
pes it is possible to develop an experimental tec hnic of instruction for 
tical use 
if 3 Before we can be assured that our method is correct, it must 
be evaluated in terms of the ability of the children to read. Thus 
itl elements of efficien y and points of weakness will be dis« overed. 
led |} A process by which the former are selected and retained and the 
tter eliminated will ensue, until a pedagogy of reading has been 
eat evolved. which will be in harmony with the laws of the most 
ne. economical learning. 
nts lhis. in brief. is the method which must be pursued not only in 
reading but in all school subjects in order to advance toward better 


not methods of instruction. As the body of signifi ant facts concern 

the ing the mental processes of children and the nature of the learning 

the process accumulates, this gradual rebuilding of educational 
practice becomes one of the most important problems of the day. 

ete 

- DEFINITION OF READING 

his Preliminary to a discussion of classroom technic in reading, I 

i" should like to state definitely what my conception of reading is. 

, In a word, I desire to define reading in a way which will indicate 

re what the essential factors in the process are, from my point of 


view. 
To read. as the term is here used, is to interpret, organize, 
remember, and deliver the thought conveyed by the symbols 
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of the printed page. This statement indicates that there are thr 
main factors involved in effective reading ability. In order to } 
able to read at all, the individual must interpret the conte: 
underlying the printed words on the page. But to understa; 
only is not enough. It will be of little benefit to the pupil merely 
to comprehend his history lesson as he reads it over. If later 
when the book is closed and he is in the class, he can remember 
little or nothing of what he read, he will not be able to parti ipat 
effectively in either recitation or discussion. Therefore, hij 
reading will not be effective unless, in addition to interpreting 
and assimilating ideas, he can also recall them. To carry th 
thought one step further, his reading cannot be said to be effectiv: 
unless he can in some way return the ideas which he has assimi 
lated. This may take the form of reproduction, or of using thes: 
ideas in some appropriate way. Therefore, effective reading 
involves carrying the thread of the story, argument, or discussion 
grasping all of the essentials, sensing the significance of the whole, 
retaining it in the mind in well-organized form, with the ideas in 
rational sequence, so that they can be delivered in some form 
According to our conception, this is real reading. Ability to read 
and ability to study are, then, in part synonymous terms, although 
study ability of course includes more than reading ability. 

What I have defined above is the complete act of reading, and 
I am quite aware that it probably ought not to be called reading 
I realize that in many cases interpretation of what is read is en 
tirely sufficient. Today, for example, I desired to go from ont 
part of the city to another. With printed directions in my hand 
all I needed to be able to do was to understand the directions 
However, there are many cases in school and in life, in which 


ability in what I have called the complete act of reading has s« 
great value that it needs to be taught to all children. In fact it 
is an indispensable ability. 


FACTORS IN READING EFFICIENCY 
In determining reading efficiency, two factors must be taken 
into consideration. In the first place, of two readers whose grasp 
of content is equally great, that one who can read the larger 


amount in a given time has the greater reading ability. Rate o! 
reading, then, is one of the two factors. In the second place, ol 


fact 

tio 
tiny 
cet 
all 
mol 
pe 
ing 


METHOD IN RI 


I ADING 
ople who can read the same amount in a given time, that 
se grasp of content is greater is the better reader. In this 
individual who can reproduce the larger amount of what 


read, and who can do so the more correctly is the more 


t The two things then, which enter into a complet 
re of re iding ability are: 1 rate of reading; and 2 
e of effective comprehension (including ability to interpret, 

e. remember, and deliver in some form 


Now, the main purpose in teaching children to read is the 
yment of power to get thought from the printed or written 
Che fact that a child or a class has the ability to pronounce 
rds fluently cannot always be taken as an indication of good 
for it may not be accompanied by adequate compre 

mn of the thought. For « xample, a child may be obliged to 
a half hour to read a page so that he comprehends the 
iwht sufficiently to reproduce 80 percent of the content 
{nother child may be able to read the same page with equal 
rstanding in a few minutes. The second pupil is, of course, 

ich more efficient reader. Real efficiency demands a satis 
torily rapid rate of reading combined with an adequate power 
omprehension. In the measurement of reading ability it 1s 
irable to combine these two factors into a final measure which 
represent the total reading ability of a child or a class. Per 

ps it will prove to be impossible to do this Reading ability 


be two-dimensional. 


INITIAL STEPS IN TEACHING READING 


The reading lessons of the first three months of school are 

l-important. They may be so conducted as to facilitate or 
hinder economical learning during the following years. Thi 

ssroom technic is important. We now know from investiga 
tions that reading is a complex, muscular, photographic, and 

imilative process. There is every reason to believe that the 
act of reading is subject to the laws of habit formation. If the 
teacher’s procedure inflicts upon the child during the first three 

mnths habits unfavorable to effective reading ability, they will 
be difficult to break in later years 

Not long ago I was familiar with a class which was taught read- 
ing during the first year by the alphabet method. The children 
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were taught to spell each unfamiliar or difficult word. This 


resulted ina pronoun ed habit of attention to textual details. \t 


the beginning of the second year a complete change in method was 


and every device known to modern educational practi 
was used to break the bad habits formed during the first y 
Rapid silent reading from books, quick recognition devices for 
reading the meaning of words and phrases, and an abundance oj 
il both in school and out were persistently used. At 
the fourth school year, however, not one of thes 
ised to pause and silently spell each difficult word 
They seemed incapable of visualizing a new word quickly and 
accurately on account of the early habit which appeared to persist 
in spite of all efforts to break it. This is not an uncommor 
experience on the part of teachers. May it not be, then, that 
when an early habit of reading with attention to textual details 
has been established it is impossible ever to eradicate it com 
pletely? May it not be that during the first year either readers 
are made or bad habits are permanently developed? If this is 
true, it is highly important that a technic be established for thi 
lirst steps in reading, whereby efficient habits of word recognition 
and of assimilation of content may be provided. 

I believe that some of our practices should be radically changed 
in some important particulars, and that real reading must he 
| from the outset. The good reader in perusing the 


rrinted page, while words are continually before his eves, does 
| b 


He is engaged primarily in thinking 


Secures 


not really see the words. 
meanings, In comprehending the thought. The early lessons in 
‘ading should produce this effect. It is my conviction that 
most of our methods are seriously at fault, because they produce 
a consciousness of word forms which is both unnecessary and highly 
unfavorable to the development of efficient reading habits. 

How, then, may the first steps in reading be taught so as to 
reduce word consciousness to a minimum? In answering this 
question I shall describe the procedure which is used in the train- 


ing department of the State Normal School at Oshkosh.’ 


Material assistance has been rendered in preparing this section by M.ss Ruberta 
N. Smith, } of the department for training primary teachers, at the State Normal 
S at Oshkosh. Several of the following paragraphs have been written by her 


fore ar 
In p 


dren ir 


on pre 
the att 


Lee 
ac c] 
nd in 
lick] 
tormes 
wholes 
re to 
meanil 
senten 
unana 


METHOD IN READING 


THE First Lessons 
irliest reading lessons involve only words which are 
a part of the children’s oral vocabularies and which are 
associated with familiar objects, ideas, or experiences. 
her’s problem is to make associations between the known 
forms and the unfamiliar visual forms. 

ling in the first grade does not begin for some time after 
opens. Frequent periods, however, are devoted to story 
simple dramatization, and conversation about interesting 
On these topics the children are led to express themselves 
and spontaneously. A basis is thus laid for the first 
lessons. This goes on for days and is guided by the 
r so that the words, phrases, and sentences on which she 
to base the first reading lessons are used again and again by 

children and herself. 
fter a time short sentences, the auditory forms of which are 
r to the children, begin to be introduced. For example, 
s some of the children have pet rabbits, and on a certain 
hese are brought to school and become the center of interest. 
ext morning a life-like picture of the mother rabbit and the 
ng rabbit may appear on the blackboard with the sentences 
big mother rabbit and This is little baby rabbit. On the 
us day these two sentences were used purposely by teacher 
children, and they are now used again many times. The 
il forms of these sentences, seen in connection with the objects 
{in connection with the frequent oral repetition of the sentences, 
tickly become associated with the objects and the auditory 
rms. These sentences are to the children unanalyzed, visual 
wholes representing certain meanings, just as spoken sentences 
re to young children complexes of sounds conveying certain 
meanings which they grasp as unanalyzed wholes. Without 
irrying the illustration further. I may say that many short 
sentences are made meaningful to the children in this way as 
unanalyzed visual wholes, in a more or less incidental manner, be- 

lore any reading is attempted. 

In presenting the first reading lesson the teacher leads the chil- 
dren into conversation on some topic about which they have talked 
on previous days, at the outset arousing the interest and securing 
the attention of the class. When the latter is at its maximum, the 
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teacher writes a sentence of from two to four words on the b! 
board, after she and the pupils have used it orally a num! 
times This sentence is at the center of interest in the con 


tion. Both teacher and children will naturally have occasj 


repeat it several times. During the conversation, and at a | 
where the sentence would naturally intervene, it is written | 
teacher as she utters it, the visual form thus appearing whi 
auditory form and the thought are in the attention of the chil 
As the sentence is rept ated, the teacher points to it so that 
children realize that the particular visual complex on t] 


stands for the particular meaning in question 

The sentence is then read by various pupils until all th 
in the class can react to it as a whole without hesitation. Ty 
sentences closely connected in thought and requiring as 
different words as possible are treated in this manner in the 
lesson. Since the children are not focally and explicitly cons 
of word forms, much less of letters or phonetic elements, a ri 
start in reading has been made. 


On the secon 


day, the sentences of the first day are r 

several times and one more sentence is developed, in thi 
manner as were those of the previous day. This continues 


number of days, not more than three new sentences being int: 
duced in two days. Each day the sentences previously devel 
are reread several times, and since they form a connected st 
this rereading is always interesting. It is held to be excel 
practice for the children to react in this way again and again to 
entire sentence as a whole. They soon catch the idea and whi 
sentence is pointed to, they respond with the whole thought as 
quickly as in their own animated conversation. To get established 
the habit of reading entire sentences as wholes, in the sai 
connected manner which children use in conversation, with t! 
thought focal in attention, is the fundamental object at th 
outset in reading. In order to accomplish this, one can afford 
to make haste slowly. 

After a number of lessons the children have a sufficient voca 
lary so that for two or three days new sentences may be con- 
structed with the words already familiar. Whole sentences 
continue to be the basis of instruction. The object is to read as 


much as possible with the small vocabulary. Words must be 
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ited again and again, but always in new combinations, 
nection with a content of vital interest to the children. 
Blackboard work continues for six weeks or two months. It 
nishes opportunity for visualizing sentences with a very brie! 
ire A shade hung at the top of the board is a useful ple ce 
paratus. Sometimes sentences may be written on strips of 
board and briefly exposed. In none of this work are the chil- 
ever allowed to read sentences word by word. 
From the ve ry first, these lessons consist of connected stories. 
Even a reading lesson of a half-dozen sentences is in the form of 
ry about something which will grip the interest of the 
lren and hold their attention. It ends in a climax which 
es them with a desire for further reading. Especially does 
teacher seek to avoid the kind of disconnected, disjoined 
itences often found in primers 


READING FROM BooKs 


\t the end of about two months of blackboard work, the class be 
to read from an easy primer. The transition from black- 


h 


ird script to the printed page is usually accomplished wit 

little difficulty. 

rhe reading continues to follow quick perception lines. Slow 
rendering of the thought word by word is always avoided. For 
example, each child may be provided with a strip of cardboard 
which may be moved down to expose a single line or sentence 

nd, then, at the word of the teacher, quickly moved back, thus 

permitting only a glance at the line. The children should at all 
times get the entire thought of a sentence before they are per- 
mitted to read it orally. It is not recommended, however, that 
children be required to look away from the book or at the teacher 
ll the time they are giving the sentences. 

It is not necessary or desirable to read one primer through 
before leaving it. The first ten or twelve pages of a half-dozen or 
more primers should be read first. Later in the year these books 
may be finished and several children’s classics may be read. The 
main purpose is to read as extensively as possible from easy and 
interesting material. 
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DEVELOPMENT OF NEW WorpDs 


rhe matter of word development is of the greatest importan 
in the early stages of reading. If the association between th 
visual form and idea is faintly made, the visual form will recal! 
the idea faintly or not at all. 

During the earliest stages of reading each new word, as has 
been previously suggested, is carefully developed through pictures, 
objects, and conversation, and presented in sentences. By the 
middle of the year, however, when the children are reading 
rather extensively from books, it is not necessary to develop all 
new words previous to reading. When an unfamiliar word occurs 
the teacher pronounces it, if the child who is reading is unable to 
do so. He pronounces it after her and the reading continues 
without interruption. The teacher notes a few of these words. 
After class she writes them on the board and devotes two or thre 
minutes to practice in pronouncing them as unanalyzed wholes. 
The teacher pronounces each word slowly, clearly, and distinctly 
as a whole and the children pronounce after her in the same way 
The period ends with a little practice in pronouncing the various 
words quickly as the teacher rapidly points to them. With a 
little instruction by the teacher, children thus catch the knack 
of pronouncing words merely by practice in pronouncing them 
Experience indicates that children unconsciously work out their 
phonetics in this manner without such a large amount of abstract 
drill as is sometimes given. A very large amount of time and 
energy is thus saved. 

ViIsuAL ANALYSIS OF WorDs 

The word-pronunciation exercises of the first year are con 
tinued in the second year, and during the latter part of the year 
they take the form of practice in the visual analysis of words 
This is conducted in the same general manner as that suggested 
for the exercises in word pronunciation. At the close of each 
reading lesson the teacher places upon the board, as previously, 
a half-dozen or more of the difficult words of the lesson. She 
indicates the syllabic form of each, pronounces it distinctly, and 
has the pupils do so. After the words have thus been gone over 
several times, the teacher points rapidly to the different words 
and has them pronounced quickly as wholes. After about two 
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weeks of this kind of work, the pupils begin to have practice in 
ividing into syllables and pronouncing words taken from the 
ling lessons and written on the board. Practice is given in 
uickly glancing at words on the board followed by syllabication 
d pronunciation. Children are encouraged to pronounce 
nfamiliar words at sight as they occur in the reading. By th 
time they are well started in the third grade they are able to 
syllabicate and pronounce any ordinary word met in their reading 
Not over four or five minutes a day are devoted to the exercises 
in visual analysis, which serves as the rounding up of the practice 
n word pronunciation of the first year and a half. 


DRILL ON WorpDs AND WorpD GRoUPS 


Children must be taught to grasp not only words but also word 
groups as wholes. The ability to read word groups by merely 
oting some familiar characteristic contributes greatly to rapid 
reading. To develop this ability drill is given with cards con 
taining words and word groups of frequent occurrence. This drill 
begins after some facility in reading has been acquired, not 
earlier than near the end of the first year. 

The drill is rapid and the periods brief. As nearly instanta 
neous perception as possible is required. The technic of the drill 
is such that the card is raised to the proper position for the 
ecognition and then lowered in a way which will provide an 
exposure sufficient for one brief glance with the card at complete 
rest. During its movement into position and back the words 
nust not be exposed. 


PHONETIC DRILL 


Certain considerations must be taken into account in con 
nection with the problem of phonetic drill. What reading habits 
are most desirable? What procedure in teaching is conducive to 
their development? These are questions which must receive 
serious consideration. Speed is a highly desirable factor in read 
ing ability, merely as a timesaver if for no other reason. All 
habits which lead to slow and ponderous reading must be avoided 
Speed in reading depends in part upon the size of the units of 
recognition, i.e., the amount which can be seen by the reader 
during eye pauses, and in part upon the duration of eye pauses. 
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The individual who sees only a small portion of the line during 


eye pause must make many fixations. The longer the eye paus 


the slower will be the reading, other things being equal. Will 
not a habit of attention to textual details inevitably result 
lowness in reading? Will not a habit of recognition throug 
dominant characteristics of words and phrases, with their minut 
irs marginal in attention, become a distinct aid in inter 
preting thought? Is not the inevitable result of two or thr 
years of persistent drill on the isolated elements of words bou 
to be a predominant habit of attention to the minute particulars 
of words? Can the eye be trained to take in large units by 
practice on small ones? Will not prolonged attention to word 
forms effectively prevent the development of a habit of thinkin, 
eanings as one reads? 

In view of the facts at hand, it seems to me to be a radi ally 
wrong procedure to introduce such a large amount of abstract 
phonetic drill in the earliest stages of reading as is often found 
It seems to me to be a very obvious inference that the predominant 

mphasis in method at the beginning must be upon the instan 
taneous recognition of words and word groups, the mental process 


eing concerned with meanings rather than with word forms. 

Is not the child afforded the best kind of drill on phoneti 
elements when he is made to react to them constantly in reading 
sentences containing words in which they occur? May not the 
additional time usually devoted to abstract phonetic drill profit 
ably be given to more reading? Will not children thus acquir 
leeling for sound and an unconscious mastery of phonetics which 
in the end, will give them sufficient power over new words and 
avoid developing the consciousness of words which prolonged 
attention to their minute particulars is likely to produce? 

It seems to me that here is a definite problem which should be 
subjected immediately to scientific investigation. It will be futile 


however, in the comparison of reading methods to test groups of 
children taught by different methods and draw conclusions from 
the results without taking into consideration a variety of other 
factors. For example, the time elements must be the same in 
both groups and the amount of supplementary outside reading 
must be the same. At least one investigation of this problem 
has fallen far short of securing a valid result on account of plain 
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of important factors of this kind. A carefully con- 
riment with every other factor identical in two groups 
presence of phonetic drill in 


1 


with the exc ptr nm ott 
} 


absence in the other would yield a most interesting 
at hand raise serious 


\t present, I believe the data a 
ibstract, phonetic drill 


; to the value of a large amount of 
the earliest stages of reading instruction. 


EXPERIENCE WITH ONE CLASS 
- children of the third grade in the training department of 
State Normal School at Oshkosh spent the first two years in 
sive reading of simple stories for pure enjoyment, with their 
tion entirely on the content. During the reading period all 
not instantly recognized were told immediately. Word 
pment was taken up in separate periods, the words being 
rporated in phrases for drill, and no attention being called to 
elements of words. Approximately fifty minutes per day 
spent on all phases of reading, including silent reading, word 
velopment and study, and oral reading. Silent reading was 
early in the first year. Before the end of the second year 
hildren began to pronounce new words without help, applying 
lependently the general knowledge of phonic laws acquired 
inconsciously through much reading 
Beginning with the third year, the children were encouraged 
ize the phonic facts so gained and the four or five most 
n principles of phonics were taught. A short period at the 
end of the day was devoted to pronouncing long words, as the 
hildren called it. This period became so popular that only with 
ifficulty were the children persuaded to omit it on special 
casions. Recently they were pronouncing with ease and 
joyment such words as hydrocarbon, hydrometer, tuberculosis, 
pitulate, centigrade, epidote, actuate, and many others of equal 
ulty, without the aid of diacritical marks or context. 
(hese children have developed insatiable appetites for reading, 
| they read intelligently and accurately with good expression 
nd excellent speed. Of the two daily reading lessons in the 
third grade, one is devoted to oral and the other to silent reading. 
fhe children are capable of reading any material suited to their 
age in content, and they read great numbers of books during spare 
periods and out of school hours. 
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READING ABILITY AS A PHASE OF STUDY ABILITY 

Definite training in silent reading is needed for the purpo 
developing in children the ability to study efficiently 
training should begin early in the first year and continue unti 
mastery of the printed page has been developed. Schools 1 
to take very pronounced steps in the direction of developin; 
special technic for teaching silent reading 

Not long ago I observed a lesson which seemed to me parti 
larly worth while for intermediate grades. While visiting sch 
in a certain community, I stepped into a room in which 
third and fourth grades. I observed that the teacher was as} 
questions from a book. The children appeared to be re 
silently and rather rapidly. Suddenly the teacher clapped 
hands. The children ceased reading immediately and cl 
their books. Various children were then called upon to tell 
substance of what they had read. They appeared to me to hay 
a remarkable ability to reproduce in great detail. I remained in 
the room, and when the reading began again it was conducted ii 
the following manner. A question was asked by the teacher 
which the first two or three sentences of the paragraph furnish 
the answer. The children read rapidly to get the facts. By t! 
time they had about grasped the meaning of these senten 
another question came from the teacher, and the process w 
repeated. In this manner there was a series of rapid-fire questio! 
from the teacher and very rapid silent reading on the part 
the class. In this way the class covered in a few minutes al 
two pages before the teacher again clapped her hands as 
signal for the closing of the books. Again there was very efficient 
oral reproduction of what had been read. I learned that tl 
reading was entirely at sight. 

I remained throughout the period, which lasted about fifteen 
minutes. It was the best example of competent teaching o! 
silent reading which I have ever seen. By her manner of questio! 
ing the teacher forced the class to read at their maximum ability 
for a short period. Five times as much was read as is ordinaril) 
read in an oral reading lesson. It should be pointed out that it is 
utterly futile to attempt to teach silent reading, from the point 
of view of developing study ability, by letting the pupils dawdl 


along at their own pace. 
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Silent reading should begin early in the first year. In its 
plest form, it consists in following directions such as Bounce 
or Run to the door—these directions being deve lope d by 
class as a game. AA little later a thoroughly familiar reading 
ibulary may be used and a group of connected sentences 
presented one after another on the blackboard. Phe response to 
is type of lesson may be discussion, dramatization, or illustra- 
n, with the use of crayons, S¢ issors, paper, clay, sand table, or 
lackboard. For example, a group of half a dozen sentences may 
describe some adventure of a kitten. After the reading has 
taken place silently sentence by sentence, the children may play 
the story or discuss the result of the adventure or its etfect on the 
kitten, or spend a seat period illustrating the points made in the 
story. 

More formal silent reading may begin in the second half of the 
first year. Children should now be able to grasp short sentences 
by quickly glancing through them, sensing the meaning without 
being explicitly conscious of the minute particulars of word forms 
Good teachers will adopt devices that give the class but a moment 

r glancing through a sentence. The class may read silently 
. group of a dozen or more sentences, after which different pupils 
may reproduce orally the meaning of what was read. This ts the 
beginning of teaching to read silently and of teaching to study. 

It is held that the ordinary oral reading lesson is unproductive in 
grades beyond the third. Instead of this the reading may well 
consist of a relatively small amount of motivated oral reading anda 
large amount of silent reading for the purpose of teaching pupils 
how to study efficiently. The regular reading period as a separate 
part of the program may be dispensed with and silent reading 
may be taught in connection with other subjects. This will 
result in a considerable saving of time. For example, on one day 
the reading lesson may consist of silent study of a history assign 
ment and may be conducted on history time. On another day 
geography may furnish the basis for a silent reading lesson 
Again, on a third day civics may serve as material for reading 
Each of these lessons will afford definite training in silent reading 
from the point of view of teaching how to study. Papers and 
special reports may be prepared from time to time. The reading 
of a report to the class is excellent motivated oral reading Per 


resourceful teacher will have no difficulty in utilizing all of 

ditferent subjects of the curriculum as valuable material for train : 
ing in silent reading. There will be no difficulty in finding plent 
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TESTING AND DIAGNOSING READING ABILITY 


Although much progress has lately been made in measurin 
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pils of approximately equal study ability in the same groups 
One of the greatest sources of waste in teaching reading has been 

keeping children under instruction in a given class after they 
advanced to a level of reading ability far beyond that con 
lated by the instruction. Probably 


b great harm has been 


children by keeping them dawdling along at a pace far 
w their ability. On the other hand, there are pupils in every 
ss in the upper grades and high school, whose level of study 
ility is so much below that contemplated by the books in use and 
instruction given, that it is impossible for such pupils to suc 
A read 


seh 


ing test designed for the purpose of diagnosing 
ls of study ability, together with instruction in silent reading, 
ld prevent many of these pupils from becoming failures and 


ild remove a source of waste and inefficiency from the schools 
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THE CORRELATION RATIO 


(mda 

In the March, April, and May numbers of the Journa 
EDUCATIONAL RESEARCH there have appeared articles by 
writer describing methods for computing the coefficients 
correlation and regression that are shorter and simpler tha 
those that have heretofore been in use. 

he purpose of this article is to describe a short method for ’ 
computing the correlation ratio which is a measure proposed 
Pearson for computing correlation in distributions in which th 
relationship between the two series is a curve relation rather than 
rectilinear. Such relationships are frequent. 

For example there may be a real relationship between th 
amount of money spent on municipal sanitation and the declin 
in the death rate. In extreme cases, such as have recently exist: 
in tropical America, conditions have been found such that slight 
expenditures for sanitation resulted in marked reductions in sick 
ness. As improvements go on, however, it is found that th 
expenditures must be greatly increased to effect even smal! 
decreases in the death rate. Similar conditions are common in 
the held of education as, for example, in the relation between th 


amount of time devoted to the practice of penmanship and th 
qu lity of the results obtained. 

rhe coefficient of correlation will not accurately measure thes 
curvilinear relations and the correlation ratio is the device that 
is proposed to obtain a trustworthy measurement of them. 

rhe correlation ratio can only be computed for tables of dis- 
tribution. It is the ratio between two standard deviations. On 
of these is the standard deviation of all the values of one series 
say the subject series. The other standard deviation is that of 
the averages of the columns of the subject values from the averag: 
of all the subject values in the table. If the relationship of the 
two serfes is rectilinear the correlation ratio is equal to the coefii 
cient of correlation. If it is curvilinear the ratio will be greater 
than the coefficient of correlation. It is always positive and 


never exceeds 1. Its symbol is 7 (eta). The best description of 
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rivation and use is found in Rugg’s Statistical Methods Ap 


to Education 
[he computation of this measure may be illustrated by finding 
the coefficient of correlation and the correlation ratio for a 
distribution table in which the relationship is roughly 
inear. The coefficient of correlation is found by the 


a. 
Sum of product t rel é 
av. of subject items tot. of rela items 
Sum ol ire sub. items Sum ors re rel te 
mit n 
total ) these items t ( t! tems 


- computations are shown in the accompanying tabulation in 

and “T” stand for “subject,” “relative,” and 

tal’’ respectively. The letter ‘ff’ means “frequencies” and 

to the entries in the body of the table. The figures in the 

nns and rows at the right and bottom of the table give the 

rations necessary for finding the coefficient of correlation, 

th the exception of the two lowest rows at the bottom which 

ire separated from the others and which represent the operations 
essary for finding the correlation ratio. 

\s the tabulation shows, the coefficient of correlation is 0.73 
[he next step is to find the correlation ratio. This is the ratio 
between two standard deviations of which the first is that of all 

items of the subject series. Since the standard deviation is 
the square root of the average of the squares of the deviations of 
the numbers of a series away from their own average, the first 
step is to find the sum of the squares of the deviations in the 
subject series 

This is 62 and it has already been found in computing the 
coefficient of correlation. It is equal to the sum of the squares of 
the subject series (678) minus the total times the average of that 
series [678 (136 4.53) =62]. 

The next step is to find the sum of the squares of the deviations 
of the averages of each column from the average of the entire 
subject series. This work can be greatly shortened by following 
the method utilized in finding the coefficient of correlation. That 


y 
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| 10 3 () | 
\v 
1 15 12 15 70 153 
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1s 18 \v If 
=St 1,024 1,600 784 324 324 
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nee 102 4 1 156 8 108 108 653 
I 
70 t 53 17 
4 53 616 
70x 2 16 
358—317 = 41 


$1 41 
r 
V 62™« 51 3.162 56.23 


method is based on the principle that the sum of the squares of 
the deviations of a series away from its average is equal to the sum 
of the squares of the numbers in the series, minus the product of 
the total of the series and its average. 

Following the same principle we find the sum of the squares 
of the deviations of the averages of the columns away from the 
average of the whole subject series. The first step is to find for 
each column the square of its average multiplied by, or weighted 
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es times their frequencies (=S/ 
In the next to the last row this number ris > squa 
t it is divided by the number of cas« 
hich is the square of the average of the 
eighted by the number of cases. This may be verilied by noting 
the sum of the values of the column is (25) plus x6) =28 
1 their average 28/5. is squared is 31.36, which weighted 
the number of cases (5) equals 156.8 
total of this last row of weighted squares of averages is 653 
this we cet the sum of th juar f tl leviations from 
bj tracting 


product of the sum of t! 


t.53=616) which gives 
Probably the best way 
ee eee | out why it is valid is to experiment 
simple illustrative cases, « irr’ ing the ork through by the 
We now have two numbers 
yuares of deviations and from them we must find the two stand 
‘d deviations and the ratio between then ich will be the 


orrelation ratio. The work is 


t 
rik LATION RATIO 455 
the number of cases in the column In symbols the desired 
v¢ 
re for each column Is to which 1s equal to 
In finding the coefthcient olf correiation we have already found 
‘S/ for each column, so the new operations may be performed by 
| 
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[Instead of dividing 37 and 62 by 30 before finding the square roots 
it is better to eliminate the two 30's. This shortens the work and 


nge the relationship between the numerator an 


Che correlation ratio is 0.77 whereas the coefficient of correla 


tion is 0.73. The difference is frequently much greater than it is 
here The added work necessary to find the correlation ratio ji 
slight. It consists for the most part in the two added lines of 
figures at the bottom of the table which are easy to get becaus 


they are derived from the other computations of the rows abov 
ich have already been used in computing the coefficient 


There are two correlation ratios for each table of distribution 
just as there are two coefficients of regression for each coefficient 
of correlation. In the case here given the other correlation ratio 
would be found by working with the relative series and the rows 
of numbers in the original table instead of with the subject 
numbers and the columns. The added columns of figures would 
be at the right of the main table instead of at the bottom. Gen 
erally the two correlation ratios are nearly identical so that it is 
not necessary to find both of them. 

Following the method described, the formula for the correla 


tion ratio becomes 


in which the subscript AS indicates that the numerator of the 
fraction is the standard deviation of the averages of the subject 
values in each column from the average of all the subject values, 
and the subscript S indicates that the denominator is the standard 
deviation of all the subject values in the table. 
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Such being the case, our problem is to discover the principles 


procedures underlying ‘ organization and operation of 


sful schos campaigns. How can their success 


insured ? fore particularly, what should be the form of organ 


tion? How ought the constituency to be analyzed for points 
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of possible contact? What avenues and instruments of appr 
to the public can be utilized? How should arguments and illust; 
tions that will really convince the voters be selected? H 
should publicity material be prepared and circulated to be 
effective? These are questions which this investigation seeks 
answer. 


Il. The METHOD 


In this study we have attempted to follow the accepted pri 


dure for matters involving as much social psychology as do pul 


city campaigns. This method is to analyze the work of success! 


men with a view to disc overing the secrets of their SUCCESSES a! 
to formulating rules for achieving similar ones by other m« 
Accordingly, we have sought the solution of our problem i: 
careful study of school campaigns that have actually succeed 


There is an art, a skill in generalship, an indefinable somethin; 


in leaders in school campaigns, which needs to be carefully analyz 
and made available for other school men. 

lo secure accounts of publicity campaigns, a letter was address 
to superintendents in cities in various parts of the Unit 
States wherever it could be learned that such methods had beer 
successfully employed.'. The letter, which briefly explained t] 
purpose of the study , contained a request for a careful dese ripti 
of the methods employed and copies of material used. <A su 
gestive list of typical situations on which information regardi 
publicity methods was being sought was inclosed with the lett 

More than seventy superintendents representing various parts 
of the country and cities of all sizes responded generously. Most 
of them described the significant phases of the campaign in thei: 
own community and many sent printed or mimeographed mat 
rials that had been used. In several instances follow-up letters 
were written to secure specific details. Wherever opportunity 
was afforded through educational gatherings of various kinds 
personal interviews were held. The data thus gathered repr 
sented every general condition. The writers have studied the 


‘In this nnection the writers are indebted to several members of the N 
Association of Directors of Educational Research for supplying information a 
n their own states that had recently passed through a campaign. Dr. B. R. Buckit 
ham furnished data for Illinois, Dr. E. J. Ashbaugh for Iowa, Dean F. J. Kell 
Kansas, and Dr. W. W. Phelan for Oklahoma. 
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Other good rules for the selection of arguments and illustrati 


may be stated thus: (1) Follow the principles of good argun 
tation 2) Establish confidence in the schools by showing thy 
accomplishments 3) Present actual facts that form the b 
for present needs +) Bring out clearly what the new prog 
will accomplish 5) Secure public endorsements by | 


6) Treat proposed costs and the ability of the community fai 
and at the psychological moment. (7) Make a list of all possi 
objections and alternative propositions; have a sound and dignili 
rebuttal for each 

It is fully as important to prepare and circulate the publicit 
material properly after it is selected as it is to select good 
ments and illustrations in the first place. But by far the 
way to learn how to prepare the form of the publicity material 
to examine carefully samples of effective school publicity, with 
view to imitating or reproducing them for one’s own sch 
system. Space forbids any attempt on our part, however, 


present such samples here. It would be as futile for us even t 


he work of preparation in a few words, as it 


try to summarize t 
would be to tell a person in a sentence how to be “interesting 
\ny treatment of this phase of the study that is to be of r 
service to the reader must contain abundant examples and illu 
tions from actual campaigns. For material of this sort the 
reader is accordingly referred to the forthcoming bulletin of 
Wisconsin State Department of Public Instruction previous; 
nentioned. 


IV. A Composite PRoGRAM 


lo save the busy superintendent time and effort, it has seem: 
advisable to map out a composite campaign with steps in chror 
logical order, embodying the best methods of all the successtu 
campaigns studied. In his own campaign the superintendent 
should strive to produce a cumulative effect with his arguments 
illustrations, and citations of fact. For complete layouts of 
campaigns extending over several months Lincoln, Nebraska and 
Denver, Colorado furnish good examples. 

The treatment of the composite campaign is given under thre 
heads with the steps under each indicated in chronological order 
I. The general publicity campaign (lasting from six months t eve 
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Improved methods of teaching reading involving motivation 
nphasize this same plea for extensive reading. Such a plea 
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Simultaneously with these demands for an extensive and vari 0 
subject matter there comes upon the market an enormous sup; 
ot readers Some are intended solely for supplementary purp 
while others are intended for regular class texts, but adverti 
as also useful for supplementary reading. Each year thou 
ind thousands of dollars are spent in providing the schools 
such materials. (While no one questions the wisdom of an an 
supply of supplementary readers, it is contended that many 
these readers have been blindly and unscientifically selected 
that too often readers selected for supplementary purposes cont 
the same stories as the basal texts. 

In order to throw some light on the overlapping in the contents 
of second readers and to secure a few facts to aid in the selecti 
of supplementary texts, a study involving the critical analysis 
the contents of fifteen second readers was made. The titles of t] 
books together with the names of the authors, and the dat 
public ation are presented in Table & 


rABLE I. TITLES OF THE FIFTEEN BOOKS SELECTED WITH 
THEIR AUTHORS AND DATES OF PUBLICATION 


\uthor Dat 
Literary You nd Field 1 selt 
\ Spalding and Brice ] { 
1-Laing hed 1 La ng 
Progressive Burchill, Ettinger, and Shimer 19 
( ll and Brooks Carroll and Brooks 19] 
Baldwin and Bendet Baldwin and Bender 191 thi 
Rational Ward 1s gre 
Riverside Van Sickle and Seegmiller 1911 val 
Elson 1913 
aiti 
Classi Norvell and Haliburton 1901 1: 
Golden Treasury Stebbins and Coolidge 1909 = 
Beacon Fassett 1914 bas 
Nature and Life Smith 1910 pre 
Cyr Cyr 1004 fal 
New Education Demarest and Van Sickk 1901 » sto 
an 
The list of books was arbitrarily chosen but an attempt was ap 
made to select those that are widely used at the present time. ty, 
f 


7; 
Lit 


3 OVERLAPPING IN READERS 167 

familiar with second-grade work will recognize both the 
nt” and the “method” type of readers The date of 
ion shows that the Rational, published in 1896, is the 
of the books considered and that the Literary and the 

|-Laing, published in 1916, are the newest. No one of tl 
is intended primarily for supplementary purposes, 

nt practice shows that any one of them is apt to be used as 
ementary text, many classrooms having five or six sets 


THe OVERLAPPING IN TYPES OF LITERATURE 
Che first phase of our problem represents an attempt to classify 
yntents of the different readers according to the different 
of literature contained. Of course such an attempt is 
but the writer is convinced that che results secured are 


reliable to show the tendency in each book. 


Most of the types of literature mentioned in Table II are 
‘explanatory, but for the convenience of the reader, it might 
well to explain what was included in such closely related types 
klore, myths, fables, and fairy stories. Folklore includes 
ind legends of the Norse, English, and Scotch, as well as 
ries from the Grimm brothers and Joel Chandler Harris. 
ths include only those selections that attempt to explain con- 
porary phenomena by the narrated occurrence; fables, those 
tions of Aesop and a few others whose purpose was to reflect 
foibles and frailties of human nature; fairy stories, those in 
vhich fairies or other benevolent spirits dominate the situation. 
Table II, representing the percent of each book devoted to 
the various types of literature, shows that the books differ a 
creat deal in the nature of their content. Probably the greatest 
value of this table is to give a bird’s eye view of the books, and to 
id in choosing a supplementary book which will emphasize 
different types of literature from those already represented in the 
basal readers. It is surprising that a majority of books devote a 
preponderance of space to such closely related fields as folklore, 
fables, fairy stories, and myths, and a meager amount of space to 
stories involving boys and girls, birds, plants, pets, fowls, plays 
and games. It would seem at once that the primary basis for 
appealing to the interest of the child has been the strange and the 
fanciful. This fact is brought out more plainly in Table II, 
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the amounts varying from 0 to 42.0 percent—is devoted to r 
nature stories; while 51.8 percent on the average—with an 
varying from 0 to 100 percent—is devoted to folklore, fairy 
and myths. A reader often devotes much more space to natur 
myths, the imaginative, than to (rue nature stories, the instru 
It is true that children like to read nature myths, but it is « 
true that they are hungry for real facts about nature. Do t 
facts not indicate a lack of balance between instructiv 
imaginative material? Do they not suggest a definite need for | 
publication of a new type of reader which emphasizes the 1 
informational material? 
DUPLICATION IN THE SELECTIONS THEMSELVES 

The previous section indicates great duplication in the typ 
material composing the contents of the different readers. 0 
can readily understand some of this duplication if he takes int 
consideration the duplication in the selections themselves. 

lable IV, giving the different selections occurring in at 
three readers and the readers in which they occur, shows a rat! 


surprising amount of overlapping. ‘‘Over in the Meadow” 
found in the Edson-Laing, Carroll and Brooks, Rational, Baldy 
and Bender, Classic, Golden Treasury, and Beacon readers. ‘T! 
Four Friends,”’ better known as “The Town Musicians,” is fou 
in the Progressive, Carroll and Brooks, Rational, Riversid 
Beacon, and New Education readers. The last column in tl 
table summarizing the number of readers containing each selecti 
shows that one selection occurs in seven readers, one selection i 
six readers, one selection in five readers, six selections in four read 
ers, and fifteen selections in three readers. A table similar to this 
one but not included in this article for want of space shows t! 
53 selections occur in two different readers. In the fifteen reack 
examined, 77 selections are repeated in from two to seven books 
The real significance of this overlapping is better set forth 
in Table V which gives the exact number of pages of duplicated 
material in any two of the books. To read this table always 
begin at the left. The figures opposite each book at the left indi 
cate the number of pages in that book devoted to the same subject 
matter contained in each of the readers shown at the tops of t! 
columns. For example, the Literary reader devotes 3.5 pages t 
material contained in the Aldine reader, 1.5 pages to material 
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in the Rational reader, and 30 pages ol material found in 


New Education reader Acvain. the Golden Treasury reader 


pages to subject matter rring in‘the Edson-Laing 
2) pages to s natter occurring 1n t Progress 
ind 20 pa to subject matter occurring in the New 


In indicating this overlapping it is not conte nded that children 


not read and re-read the same selections for indeed they 
for certain selections and seem never to tire of them. 
It is poor economy, however, both from the standpoint of the 


ney involved and from the standpoint of introduc ing the child 
he activities of life’s complex environment to buy a supple 
ry reader which extensively duplicates the material already 

contained in the basal reader, 

As stated above, children should re-read stories and they call 
ardently for their favorite selections, but they want exact rept 
titions and not abridged or modified versions in another book 


Better practice, from the standpoint of modern theories of edu 


‘tion. would be to utilize the same words in different stories in 


olving various aspects of the social environment of the child, 


Inj t t no been 1 to 
t i tion of itr ers, nor I t been made to 

t for the cau f the « in I ion has yrtrayed as it is 
1 tl that I n nd teachers will be more careful in the election of 
their supplementary read 
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ined in the Edson-Laing, etc. The presence ot small num- 
rlapping. 
Education reader. Do not t facts sugge possibility ol 
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rather than to use the same words in different versions of 


story. Such a practice would eliminate the duplication of s 
SUGGESTIONS FOR AVOIDANCE OF DUPLICATION 


rhe facts presented in the previous sections indicate tv 
defined tendencies: first, that of employing the imaginati 


of literature; and second, that of repealing the same s 


in the various readers. However, with a little precaution i: 
selection of the basal and supplementary readers, any undesi 


effects of these tendencies may be avoided. 

If the basal reader is one which emph 
naterial as indicated in Table III (or through similar 


other books), the selection of supplementary readers emp! 


instructive material—i.e., biography, history, true stori 
plants, animals, boys, and girls, ete.-—would furnish variet 
the types of reading materials and would harmonize with 
social interpretation of education 

Reference to Tables IV and V would facilitate a choic 
books without duplication of the selections themselves 
illustrate, suppose the Literary reader is the basic text ar 
supplementary text is to be ani n. Table ILI shows that 88 
percent of the content of the Literary reader is of the imaginati 
type—the particular form of which can be found in Table II 
desired. Obviously, if one acce pts the social theory of edu 
the supplementary book should be of the informational 
From Table III it is seen that four readers—Rational, Ba! 
and Bender, Nature and Life, and Cyr—contain more than 50 
percent instructive material. Table V shows that little or: 
duplication exists between the Literary reader and any of th 
books, and consequently any one of them would make a go 
companion book so far as subject matter is concerned. It 
evident that such comparisons become of more value as the nu 
ber of readers, supplementary, companion, or basal increases 

The above tables suggest a method of analysis which s! 
prove helpful. Until some such method is followed school peop 
will continue to select books unscientifically and to deprive t) 
children of reading matter of sufficient variety to introduce 
them to the complexities of the social life with which they are 


surrounded, 


r) 
q = 
+} 
4 


r FIRST-GRADE CHILDREN CAN DO-IN SCHOOL 
AS RELATED TO WHAT IS SHOWN 
BY MENTAL TESTS 


\ T) 
r ; 
st ree years, mental testin S n « ied on 
it} st-grade children at O nd It has been 
that a very high percentage of t vho test below 
lal odaat Worl cl 1 Set up as 
r pupu It was decided in August, 1918 
experiment by s« e of ow 

i t he the mentat est the lel 
in iwo schools were s¢ cted where there vere large 

s pupius reported DV Ci aS CTIOU 
for education. We shall refer to these schools as 


iter-front district where the social conditions are 
the leas desirable of the city. According to a recent 
15 percent of all children attending Si hool A are foreign 
65 percent of the fathers and 61 percent of the mother 
eign born, chiefly Austrian, Italian, and Portuguese. Of 


ildren attending School B, 15 percent are foreign born 
5 percent of the fathers and 57 percent of the mothers are 
born. Here, the Pi ese element predominates 
School A, the children of the low-first grade were segregated 
roups 
| border eTroun ] S5 below 
\ group slightly better, either because of higher mental 
higher I. Q., but still below normal. This, we called the 
ore 


The normal group, plus a few who tested superior. 


h of these groups a few shifts were made up or down on 
i 


isis of the school experience of the individual child. Som«e 
ror 
70. ) it bel 
> | ) 17 
» test } » as 80 sh be clas la ‘ 


1 A and RY in mant- 
‘ 
4 be 
ve Ol 
the | 
{ 
w] 
| 475 


the children had been in school only a short time and 
| attended one, two, or three terms. The accompanyi: 
' ta concerning the 25 children who were placed 
est er Ip This. we shall refer to as Group I, School \ 
This table includes all the pupils in the low-tirst 
hool A who classified in the borderzone group, m« 
Eight of these pupils tested below 70 I. Q.; ten, 70 to 79 in 
nd seven, 80 to 87 inclusive. At the time the ex 
n (August, 1918) three of the children were in the thr 
me ( up, nine were in the four-year mental ag: 
twelve in tl ve-year mental dge group, and one in tl 
mental croul In chronological age, fourteen are 1 
tween vel nd eight years, eight are between eight 
vears, and three between nine and ten years. 
Considering the fathers of these children, eleven w 
n Portu e in Italy, three in Austria, two in Assyria 
Spain, one in Greece, one in England, and one in the B 
Stat Of the mothers, eight were born in Portugal 


Honolulu (Portuguese), five in Italy, three in Austria, tw 
Assvria, one in Spain, three in the United States (all foreig: 
nationality), one in Russia, and one in the Balkan States. F1 
this, it will be observed that our problem involves a foreig: 
ment entirely. However all of the children spoke English 1 
t school prior to the time the segregation was mad 
The social status as indicated by the occupations of 
fathers is as follows: five were laborers in the ship yards; ei 
laborers in the railroad shops; three, laborers on ferry bi 


le 


three, teamsters; five, day laborers; one, vegetable vender. 
\ strong primary teacher who was interested in this group 


children was given the class. She was allowed freedom in met! 


and equipment and told to do the best she could to educate thes 


children She has labored faithfully for a whole vear, 
about three-fourths of the present term, with the result t) 
on'y six of the 25 children can now read in an easy primer, 


these do not read quite as well as the pupils in the normal cla 
of the same school who began work this term. This statement 


regarding reading ability is based on an individual test for sp 
and accuracy in naming words in an easy primer not form 


used by the pupils. The reading of these 25 children was con 


pared with that of twenty children who tested in the norma! 
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”) WHAT FIRST-GRADE CHILDREN CAN DO 177 4 
GROUP I, SCHOOL A 
i 
40 
il 
} 
1 
} 
? 
50 
7-11 
7 
up and who had attended the first grade for only t! urths 
term. The six pupils who have learned to read fairl ell 


re numbers 1. 4, 5, 9, 15, and 23. Numbers 1, 4, and 5 have 


pent three terms each in school prior to the beginning of this 
term; numbers 9 and 23 have spent two terms prior to the present, 

; and number 15 has spent four terms. 

i According to the teacher’s judgment, these six children are the 


only ones of this group who now have approximately the capacity 


| 


SIX OF group 1p 
term. eight, two terms. and two, tl 
now ympleted two and three quart 


exp riment began, and only even ol 


learning to read approximately as wi 


ra but cannot do indenendent 

‘ ider Ni t one 31s Cons 
: ivision to re able to lo the Sta la 
higt cle ild 


children in School A was composed 


The te ver attributed the failure 
ittendance and of one to excessive timi 


hirty of the pupils who tested below 


» classified in the dull normal group or 
special first-grade division. Of the 


work ot tne iirst erade ten h ivi 


and four, one term. The teacher o! 


At the end of two terms of wo 

e regular class. Now, near the « 
acner report s ive more ready tor 


are not yet ready to be put into such a clas 


pupils out of the thirty were promoted 


NAL EDI rIONAL RI ARCH 
Pst-2TAce WOTK | sne believe vould not long 
pace if put In a with normal first-grade children | 
Ver 1 normal chi 1 and require much mor 
irder - york thev are learning 
Spac 1) this i will not permit detailed treatment 
data in each other group Group II, Scho \ 
con sed of 29 children who tested better than those in G 
oT ) | rOtiy petter 1) ibilitv for hool 
The ver isidered the dull normal roup oixteen 
the five-year mental age group; three, in the tour-vear 
ie group; and ten, in t six-year mental age group | I. 
range was from 75 to 95 This group was placed in char 
good primary teacher, who was likewise instructed to ed 
these children the | im 11) 
and course Ol stu tt 
it i OT 
Che children hav rs t 
verage pupil in tl 1 
otners can 1 ne iding 
n unfamiliar | ler 
the te icher o t} W I 
1 re ir oO] 
Group lll of 
who tested normal or above. There were 42 in this class ar 
but tive of them passed the work of the recular first grade at 1 
end of the term fo 
these to irregular 
[n School B, sis; Pa 
mentally and wl 
‘ 
were placed in a i 
+] 
was instructed to do wor t w: near YOSSI the stan 
] 
for the first gra under ¢ 
experiment, tw nt 
the high-tirst-g: 1 of 1 ver 
third term, the rst 
{ 


of the three groups testing below normal has been 
) a speci teacher wl re ined with that group 
r and a halt is to have the group with 
teacher It perl xd ot VO s in order that the 
‘ p iment 1a ) oT t] 
perintendent ot schools has appointed a committee 
of the supervisor of primary grades, the teachers 
these divisions under experiment, and three other 
teachers to follow this experiment carefully and report 


mmittee arrived at the following tentative conclusions 
end of the first year (June 20, 1919 
That children who test below six years, ment lly, and who 
Ww by classroom behavior that th« \ are below average in 


rtness should be segregated near the beginning of the 


into a special division not to exceed 25 in each group 
the regular first-grade work should not be attempted 


\ course of study should be mad adapted to their needs 
3. These children should move up through grade work more 
pr bably, than normal children, but not so slowly as that 
l pecome discouraged through lack of progress. 
y program of the teacher should be sufficiently 
to permit the development each day of the problems of 


vital concern to the class on that day. 


5. The next problem for the committee to attack is the making 
vurse of study suited to the needs of such pupils 
\ rding Lo the teachers of the three classes of mentally 


the first problems in the education of these children 

the teaching of cleanliness, hygiene, social adaptability, 

rty_rights, and the removal of fe ar of corporal punishment. 

Particularly do they emphasize the fact that these children get 

nv knocks and blows from their associates on the street 

in the home, that they become victims of an attitude of fear 

istrust which is very hard to overcome in the classroom 

fhe customary thing is for the child to shrink or dodge whenever 
teacher or any one else approaches 

fort has been made to teach as much as possible of reading 

| number work, and to increase the vocabulary through con- 

versation, dramatization, story telling, games, and handwork. 

The children are very slow to comprehend, slow to act, and what 


eems to be learned one day is lost before the next. Memory 


1 +] 
i 
j 
an 


must De used more extensively than with normal childre 


[he policy proposed by the committee mentioned 
being gradually introduced into the schools of Oakland 
the i> rmit, and the committet cen 
the superintendent to proceed 1n the development ol! a « 

| 
study for e first and second years of schooling which 


adapted to the needs of children who show by test 1 


| 


mentally retarded and wl 


unable to attack, successfully, the regular work of the fir 


» also show by brief trial that 


SUMMARY AND CONCLUSIONS 


| Ment tests of several hundred first-grade childr 
shown that mental age and I. Q. are important factors in r 
child’s cl es for success in his school worl! 
?. Most children who fail in the first grade show ment 


3. An experiment covering a year and a half leads us 


prove the pl in of se¢ itl pupils in the first grade acc 
to m¢ il capacity 
The individual mental test Staniore Revi 
worthy in determining such segregation in almost all « 
| | 
5. 4 lren who test low are very slow to learn to read 


What they appear to learn one « 
retained to the next. Much drill and repetition are necess 
Their reading is marked by a tendency to name words wit 


thought of the meaning 
6. A special course of study should be given to children 


show serious-mental retardation. ‘They should be led up thr 


their school course according to their capacities and needs rat! 


than according to formal grade standards. 
7. Segregation of those who are retarded should occur durin 
the first term or at the end of the first term in school, after t 
child has been ‘“‘exposed”’ to the regular work. Some of o1 
mmittee feel that th nasa Le nilace i 
teel that the segregation should take place Immecdla 


after the child’s entrance to school.) 


8. Several hundred children in Oakland are now segregat 


into special groups according to mental capacity and the plan 


being rapidly extended. 
9. A committee is now at work arranging a course of study t 
meet the needs of retarded children in their first two school ye 
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and retention seem very poor; therefore repetition and 
‘ 
Tht 
n 


rHE CAMPAIGN MI 
EDUCATION 


ining to them? 


What would the 

Of course, we attempt to stimulate interest in the 
iate test, and I suspect that many a teacher warns 
ionally that another test may be given sometime an 


ne may 


much 


she wants the class prepared. 
hort the class group to make a good class score, and however 


h we may claim that group tests are designed to ‘“‘measuré 
efficiency of the entire school, not the individual ability of 
yet it is the individual who must take the tests. 


But 


PHOD IN ELEMI 


howe\ er 


do about 


N TARY 


the tests 


dk sirability ol 


W. R 
value of st rdized test the purpose of cl 
ts oO sroom instruction are recognized b 
( ize that the method of using the tests h 
ul indardized Briefly, supervisors an 
e them as sis of judgment respecti e accon 
iven task. If test results are hig | are 
low. word is passed to teachers to empha 
nhase of their work a little more in he teacl 
ions. Let us not examine the charact f thi 
y. Weall know what e1 FAL 
subject means. Later the test is re] ea 
or lowered in rank according to the ling 
t is closed 
NATURE OF THE CAMPAIGN METHOD 
hat of that other great class oi school } le 
pul ils themselves What use do they make of 
What do they know of grade standards and the 


if the. di 
im 
her clas 


1 tha 


th 


In tl 


termediate grades we have the beginnings of group consci 
ness, but the individual is the dominant factor. 


retical standpoint we 
lividual pupils even more than we are warranted in consider 


ndividual teachers. 


From a practical standpoint, we have t 


should be 


warrantet 


He 


in 


nce, from 


consideri! 


} 


t 
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1 
on Ol pupils when 
) n 
lial ni the 
pn e ot the w 


oi the a Iministrative details of t] 
we have chosen our topi 
ventary Education 
rized: first, by a recognized n 
se who organize it; second, by d 


. 
lose: third, bv a definitely 


ind sustain inter*st A fourth ch 
that the success or failure of a « 


uals other than those who « 


value in awakening the individ 


operation whether civic, social, 


r? 


ncerned with three campaigns carri 


purpose of improving the worl 
i i 
in whole numbers, although 


rant thy hehef t} it the plan is ] 


cl nical phases ol oth I Cc! 


of educational research in the Hibbi 


fail of 1915, one of our first acts w 


Research Tests in Aritl 
‘Tre DeLOW Stal 


achers were called together and aske 


in the four fundamental processes 
turned our personal attention to 


of our buildings. Ten intermed! 


having sixty minute pe riods for recitation 
in the departmental group. With 
another form of the Series B Tests 


weeks with “emphasized” work in 


ahi: 
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ed to ire idence 
Campaign M lin E] 
\ n ign is cl u 
desire on the part of th 
tir imits, particularly fo 
ized effort to stimulate ract 
is determined by indivi ni 
whether it be by voters in th political campaign, converts in t 
relign revival, or subscribers to the fund Furthermo 
campaign has a peculiar to 
cutie privil 
or intellectual 
his report will be 
ir lar nt proces ye J 
: school worl 
fue First CAMPAIGN 
When we took charge 
Series B. We found that scores 
\ccordingly the tc asked | 
~ ph ize’ tne work W 
subtect 
In January of that school vear, it was decided to introduce t 
departmental plan at one of 
erade classes each an : 
supervised study 
introduction of thi was 
given. Nine school 
| 
| 


of 


lapsed since the first test yrovement, howevs 
\ ) nul ibers Was ) INnc©re 
yveen made in s ra [t was decided that 
b d m In } \ 1 VO te riche 
1 | 1 ithmeti Ci Vas id to 
vith the pupils who had made the lowest re 
eets were placed the names of all the pupils and 
h nam ere the scores made by that pupil in the 
id January i ts bla 1] n ither test 


he blank spaces after each name, however, tended to 
personal appeal for preparedness These name sheets 
Wl h charts showing class rit li ins, were placed on the 


rithmetic rooms 


t. the teachers listed, for their own information, the names 
who had made the low cores These pupils 
| tu ey musi do outside worl Thus, in the be vin 
verlooked another characteristic of the true campaign 
f securing action by stimulating interest we were going 

{ drive started The pupils on the low score list were 
nimeographed sheets of examples to work at home. 
ut in extra time before and after school. Pupils who 


lis extra work whe n they Saw othe r 
became concerned about their own standing 
esult was that they, too, asked for drill sheets to take home. 
they commenced coming a little earlier in the morning and 
they were working as industriously as the others. Fror 

on the work was largely voluntary on the part ol 1 
r pupils as well. They timed themselves and each other, and 
timated, as closely as possible, the improvement due to practice. 
[he pupils were shown how to make individual charts and these 


led to them even more than did the numbers representing 


scores. The standard was represented by a red line and thi 
l’s performance by a green one. “Raise the green above the 
became the slogan 

lhe pupils had become so intensely interested in this phase ol 


work, and the amount of class time given to it was so limite 
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‘ 
to follow. The date ot this third test had not been set. 
one of the four chief characteristics of a campaign was 
in t 
he 
4 


ing represented a gain o ran I 
cases two vears or more, if we « rain O 
t normal year’s prog! But a still greater 
ccura In Janua th eginning of tl 
of four « one in ea indamental ope 
ten t ol ) li i, 4 
lor act Or YO pel 
below 70 Bu A it th 
ixteen 10 percent of the cases were abovi 
ira | none were below 70 percent. Thi 
ment in the [th 1d ng ( for bo h rate 
phi s] n in | ires 1 and 2 
| campaign results fell short of the origi 
pa We expected t oost the makers ol 
the cl median, ¢ rd for the 
too low, and let the rest { pu 
would secure closely graded, hor ( 
respect to the four fundamental processes in 
But class variation increased rather than d 
there wi: sreater diflerence in the number o 
) the highest and the lowest pupils at the end 
period than there had been at the beginning 
while the low score makers were advanced tl! 
makers retused to “stay put Truly, it has 
brightest pils are the most retarded.’ 


IND CAMPAIGN 


The next school vear the tests were not us 
1917 we organized our second campaign 


W 
Ol 


( 
( 
i 
() ] 
i 
1S 
{ 
47 
Lilie 
( 
&. 
ry ~ 


of the characteristics of a true campaign were observed 
in order that the regular work might proceed under tl 
favorable conditions, we felt the desirability « inging the 
of the intermediate grades to a relatively high degree of ex 

s early in the year as possible. Second, definite time limit 
set. The campaign was to start just one month 


five to eight minutes dail that we saw no reason for 
it ( lo ee] est \ ep 
In this discussi not give iled ires Bri 
however, it may be stated that the improvement in 1 
campal 
ion) for « 
| 
| 
‘d. But intl 
of This time all 
| 
4 
| 
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1 and was to close in exactly six weeks, finishing, therefore, 
ore Thanksgiving. Third, we made an organized effort to 


te and sustain interest throughout the period; and fourt! 
success or failure would depend upon pupil perform 

e.Le.. would depend upon individuals other than th organizers 
In planning the second campaign so many factors were fou d 
ed study that we arbitrarily selected some and discarded 


hers. For example. we knew that wide variation existed in 
lass and we knew that the plan followed in the first study 


| | 


Siz; > Deve ce pup finer 
SIGURE LVEVELOPMEL ¥Z 
Ai MULT, TION 
7, 
— 
j 
\ 
‘ 
~ 
. 
1 
would increase variability. But rather than discard the 


altoge ther it was decided to overlook this defect, since overt! 
ing would not handicap a pupil in his work and since the peri 
such overtraining was to be short. Indeed, the only a 


would have been to discard the plan entirely, since the succ 
any campaign depends upon “boosters” among the people | 


paigned. Witness the preponderance of Democrats at a de: 
cratic rally or of Christian people at a religious revival. W 
determined, however, to obtain some check upon this phas 
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ition. At the beginning of the campaign the median of all 


h grade, judged by the performance of its median pupil, was 


wed that, with but one exception, each crade median was 


ng of voluntary 
ended ie four the « 
In SCI \ ( | ‘ 
\ 
er ol in ¢ i 
EQ tn lof =/) 
‘ (}in the tourthn 1 the ¢ 
Lime iven to al wor! s limited to te 
+1 
CX the case Ol the ( 
i 
neral plans were tollowed Li 
] ] 1; 
ts were displa | 
t the wan LOT I ca 
t her was asked to use her judgment in ing 
en to individuals whom she considered phys 
outs! VOT? But this time pupils re illowed 
| 
umber « nples which tl t In for correct) 


of the second « 1 were clear cut decisive 

t test (the one given the begin of tl ecol 
rev led the fact that the pup! were wt aed 

ity in fundamental operations with integers, since 
in general, a difference of one to two examples 
n each two successive grades and since in only one case did 
le median equal that of the next higher grade in any of th 


rations. Furthermore, each grade median 1n rate wi 


of those of the fourth grade in subtraction and multiph 


was within one example of the Courtis standar 


lhe second test civen at the end of the six-week pe riod, 


that which the next higher grade had earned at the begin 


of the period. The one exception was the fifth grade in 


accuracies for all five grades in the four operations wa 
rcent; at the end it was 78 percent with o7 ly two cases below 


ercent, these being in the sixties. At the end of the period, 


er prepared to deal with integers than the grade above had 


EATENTARY EDUCATION’ IGN 12 
ELEM 
most part these examples were Neve clLed I 
+ will be touched upon again in connection with the third 


been at the beginning of the campaign. These facts are s] 


| o In terms Lneir Ow! | ertormance, all grades combi 
i! operations com ined Improved tne rate ol Work ons 
ind worked one-thit | more examples correctly. 
4 
| 
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As stated before, the pupils kept records of the number 
examples worked outside of class. The pupils of each grade w 
grouped on this basis. For each process, Group I was mad 
pupils who reported that they worked less than on 
examples; Group II reported 100 to 199 examples; Group III { 
200 to 299 examples; and Group IV, 300 or more examples. 1 
group medians in each grade and process were found for the t 
given at the beginning and at the end of the six weeks’ camp 
here were four groups for each grade, and each group h 
medians, one in each process, except the fourth grade in divisi 
hus there were nineteen medians for Group I—three for t 
fourth grade, and four each for the succeeding grades. Simi 
there were nineteen medians for Group II, nineteen for Group II] 
and nineteen for Group IV. Taking the median of these medians 
for each group, figures are obtained that represent respective! 
the performances of pupils who worked less than 100 examples 


100 to 199 examples, 200 to 299 examples, and 300 or mor of 


examples. 
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figures reveal a high positive correlation between the 
f examples worked and progress. In rate of working, the 
ip of pupils (who worked less than one hundred examples 

than two examples; the second group gained a little 
, two, the third three, and the fourth four and one-half, 
rs’ growth in the six weeks. In the number of examples 
correctly, the gains were 1.2 for Group I; 2.7 for Group 
yr Group III; and 4.5 for Group IV. 

d with Group I, the most industrious group not only 
re than twice the gain in rate, and almost four times the 
umber worked corre tly, but these gains were also made 
isis of a higher initial score. In the beginning there was 

ence of approximately two examples in rate and one 

in number correct between Groups I and IV. 

Tue Turrp CAMPAIGN 

We intended to use this information in the third campaign to 
nducted in the fall of 1919. We were going to give each 
immediately following the initial test, a personal folder 
ining the number of examples in each process which he should 
) bring his score up to the grade standard. This could be 
led that it would prove an additional incentive to work. 
But as the time for the third campaign approached, a large part 
writer’s time was taken up somewhat unexpectedly with 
trative details in connection with our outlying schools. 
It was found impossible to give even the usual amount of attention 
to the campaign just at that time. Hence, it was decided to 
ceed with a very simple form of organization. The teachers 
the tests. Clerks scored the papers and made out individual 
re lists which were displayed in the arithmetic rooms. An 
ement was made to the teachers that the campaign would 
close in six weeks, and they were asked to encourage the pupils 
ractice for the purpose of raising their scores. They were 
ked to limit class-time drill to ten minutes daily. They 
furnished with self-keyed drill cards for the outside work; 

! by a judicious distribution of these, overtraining was par- 

lly eliminated. Clerical help was provided to correct part of 

papers. The amount of work turned in had made correction 
of papers impossible in the second campaign, but this time with 
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the help of self-keyed examples and some clerks, it was 
After correction, the papers were returned to the pupils 
recorded the number worked correctly. 

The initial and final tests were given to grades Iv to vi 
the campaign was confined to the fourth, fifth, and sixth gr 
The seventh and eighth grades served as controls. 

The value of the plan, even when thus hastily and impert 
organized, was apparent when the second test papers were 
In the fourth, fifth, and sixth grades the median of all th 
made by all grades in all processes was 1.7 examples bot! 
number worked and in number worked correctly. This indi 
a gain in percent of accuracy. In the seventh and eighth grades 
on the other hand, the gain was one-half of one example bot! 
number worked and in number worked correctly. Furthern 
at the beginning of the campaign in the fourth, fifth, and 
grades, no grade median in any process was equal to the Court 
standard for the grade except the fifth-grade medians in subtr 
tion and division which exceeded it by one-tenth and two-tent 
of one example respectively. But at the end of the campai 
each grade median equaled or exceeded the standard in 
process except the fourth grade in multiplication which missé 
by one-tenth of one example. We are unable to report evide: 
of any value in having the pupils count only the examples t! 
had correct, rather than having them count all examples wor! 
Using the same method of computing gain as that used for the 
second campaign, the gain in accuracy was only one-half as great 


as in the second campaign. This feature of the work should not tie 
be discarded, however, without further study because in th t} 
second campaign all pupils had been campaigned indiscriminate] si 
while in the third campaign the subject was not emphasized 
much in the better classes as in the poorer ones. t 
PERMANENCY OF ACQUISITION pr 


The second campaign was conducted between October 3, 1917 
and November 15, 1917. In June of that year a third form of th: 
Courtis test was given. The object was to find out how muc! 
of the gain made during the second campaign had proved to be 
permanent. Only the scores of pupils who took all the tests wer 
considered. Approximately the same results were obtained 
at the end of the campaign in November. Slight additional 


+} 

n 

n 
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- were made in the lower grades, while small losses were 
ined in the upper grades. It will be recalled that in the 
ks of the second campaign pupils had in general improved 
irth in rate of work and one-third in accuracy. The June 
wed that the effect had lasted seven months. 
third campaign, which was conducted in the fall of 1919, 
ed an opportunity to estimate the permanency of thesé 
; over a still longer period. Two years had elapsed. The 
h. fifth, and sixth grades had now become the sixth, seventh, 
ighth respectively. The first test in the third campaign 
| in these grades the effects of the training two years before. 
it three cases were these grades below the present grade 


-ds as much as one example, even within a month after the 
nning of the school year. In another month, without any 
tention to the subject in the seventh and eighth grades, except 


siving of the tests, no grade median in any process was found 
be below the present standard as much as one example. 


SUMMARY AND CONCLUSIONS 

lo summarize, the first campaign with ten classes showed us 

possibilities of the plan, but eleven weeks’ work resulted in 
vertraining for most of the pupils. The second campaign, 
irefully organized and administered, caused each grade to attain 

performance in excess of that of the next higher grade at the 

inning of the campaign. This campaign also proved the 

sitive correlation between amount of work and progress. The 
third campaign, hastily organized, and administered wholly by 
achers, resulted in a gain of almost two examples. And from 
he first test of this campaign was obtained some evidence of the 
permanent value of the previous one. 

In discussing the characteristics of a campaign, we mentioned 
its value as a means of awakening individuals to the duties and 
privileges of cooperation. It is impossible to gauge this value 
xactly any more than we can calculate the degree of national 
wakening due to the Liberty Loan campaigns or the broadening 

human sympathies due to the great war-relief drives. Yet 
is certain that these school campaigns were valuable in fostering 
Pupils sought aid of each other, and 


the spirit of cooperation. 
in turn, offered help; parents were asked by their children to time 
in 


nd examine the home work; and the schools themselves came 


ae 
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for their share of parental attention. If you doubt this, st 


campaign in your school in arithmetic or geography or spelling 
English. But allow me to suggest the inadvisabilit 
rting more than one at a time, or of following one too c| 
the 
\ny one who has ever seen pupils of the intermediate 
ur grades gathered around a chart dealing with any 
of their school work ranging from school attendance to clas 


performance will not deny the possibilities of a further u 
Children, like the rest of us, want to know 
what their task is, and particularly what the limits are. M 
over, they work best when they know that their own performar 
rather than some teacher’s judgment will decide the success 
failure of their efforts. We have tended too much, in school 
work, to emphasize the lower limit—the passing mark—and | 
refuse to acknowledge the possibility of any pupils reaching th 


upper limit—100 percent. Children refuse to accept this vie 
of their own limitations, but what can they do about it? Eve 
when the teacher knows exactly what she wants, the pupil 

ldom know. Their task is to keep busy and avoid maki 
trouble. Their problem is analogous to what ours would bi 
we were sent to a machine shop or a prescription counter « 
lawyer's office and told to keep busy, to learn as much as pos 

ut mechanics or drugs or the law, and, above all, not to di 
nyone else. But how different the pupil’s problem beco: 


when he knows exactly what he can do now, and what he is c! 
lenged to be able to do at a given time; and when he knows t! 
the success or failure of his efforts will be determined by his ow 
performance at that time. 

\llow me to say in conclusion that although we do not 
know the limitations of the plan, we do know that we can caus 


grade to make a year’s normal progress in the use of whole numb« 
in six weeks. And although we do not hail it as a panacea for 
the ills of elementary education, we are firmly convinced of t 


value of the campaign plan in all aspects of school work whi 

depend upon the memorizing process or the acquisition of skill, or : 

in any field where definite standards can be established and u 
reliable measures of attainment are available. v 


EDUCATIONAL MEASUREMENTS IN A 
SMALL SCHOOL SYSTEM 


FRANK H. Koos 


Superintendent Schools, Anoka, Minn 


Really to know how the results of teaching fundamental sub 
in their school system compared with the work of other 


nizations over the country became the desire of the teachers 
{Anoka city schools. They had been told that the schools were 


best in the land by patrons and by school board members. Th: 
te inspectors who spent from half a day to a day each year with 
said that the instruction was good. But these snap judg- 
ts hardly sufficed to give any satisfaction in the face of present 
y ducational science. 
lhe desire to know caused these teachers to measure their work 
standards which were being used in other school systems. 
[hey made a study of many tests and school surveys in order to 
ure means for testing and data for comparison. They used as 
xts Educational Tests and Measurements by Monroe, DeVoss 
ind Kelly, and The Scientific Measurement of Classroom Products 
Chapman and Rush. The instructions and directions for all 
sts were studied very carefully. It was finally decided that the 
hool work should be measured by the following scales and tests: 
1. Ayres Handwriting Scale, “Gettysburg Edition” 
2. Ayres Spelling Scale 
3. Nassau County Supplement to the Hillegas Composition 
Scale 
!. Thorndike Scale Alpha 2 for Measuring the Understanding 
of Sentences 
5. Kansas Silent Reading Tests 
6. Courtis Standard Research Tests in Arithmetic 
7. Stone Reasoning Tests 
8. Trabue Completion-Test Language Scales. 
In order to make the giving and grading of the tests as uniform 
as possible and in order that the burden should not be too great 
pon any group of individuals, a number of teachers’ meetings 
were conducted. These served to familiarize all the teachers with 
the giving and scoring of tests and papers. In every case the 
493 
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teachers’ results were checked by one to four competent perso: 
Che board of education thought the work of so much worth t 
it secured extra clerical help for checking and tabulating. 

The work began in March, 1919, and ended early in May 
consumed a great deal of time and energy but the satisfactio 
knowing where we were weak and where we were strong 
than repaid us for all our pains. 

Because spelling tests were the easiest to correct, we began wit 
that branch of the work. We found that the Springfield, Butte 
Elyria school surveys used those word columns which dema: 


a spelling ability of 73. Accordingly, words were taken 
those lists. Table I shows the median scores made by grades 
to vu. It also gives the scores made by other school syst 


We find by comparison that Anoka stands a little better in aln 
every grade (except the third) than three other systems and wor 
than two. That is, the teaching of spelling may be characteriz 
as average except in the third-grade classes. In these classes, th u 
results were poor. 

The fact that the third-grade classes fell so far below the rest 
the system demanded explanation and caused investigatio1 
From the age-grade table we found that the average age for t! c 
fourth-grade classes at the beginning of the year was nine y 
and five months. The average of the third-grade classes was ni! 
years and eight months. This indicated retardation. Up 
investigation with the opposites and the Binet-Simon test 
eleven subnormal individuals were found in this grade. This \ 
may have been the cause of the poor spelling. However, other 
causes were found to be the lack of suitable lists of words and poor 
teaching methods. There was too little individual attention, too 
much repetition of easy words, too little repetition of ditt 
words, too much oral spelling, and not enough sentence dictation 

The tests brought to us better methods of teaching spelling 
The sixteenth and eighteenth yearbooks of the National Society 
for the Study of Education, all other available material upon th 
teaching of spelling, and word lists were brought into use. Nu 
merous tests and contests were undertaken. During September 
1919, tests were given again. Another sampling will be taken ir 
March, 1920, in order to measure improvement. 


| , 
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rABLE I. AYRES SPELLING SCALI MEDIAN SCORE 


\> 
W B 4 { I \ 
g } Mi Fil ) \ 

School 
77 SY 70 RO 69 x) 
59 37 48 65 64 ) 
65 S1 73 70 79 70 67 . 
74 82 78 72 R5 68 69 
Ri) 75 78 7S 74 
77 S1 79 73 76 69 | g) 73 

} 74 75 89 67 ( R6 


Because we could secure results for comparison from the vari 
sources and because of the ease of scoring, we adopted the 
Kansas Silent Reading Tests to measure our results in silent read 
lable II gives the median results for the two Anoka grade 
‘dings. With the exceptions of one third grade, one seventh 
nd one eighth grade, the scores stand well above the average. 
(his third-grade score is low because the whole group had been 


divided into divisions upon an intelligence basis. The section 
which made the low marks was the slowest moving division. The 

w record made by the Washington seventh grade may be ac- 

unted for by the fact that the regular teacher was called home on 
ccount of sickness. She and her substitute were going over the 
week’s plans while the youngsters were taking the tests. We 
uld in no way account for the work done on this test by one 
eighth grade. In order to find further proof tor poor reading 

ility in the two grades mentioned, we administered the Thorn- 
dike Scale Alpha 2 for Measuring the Understanding of Sentences. 
[he score made by the children was that standard of “8” given by 
lhorndike for the second year in high school. However, as we 
know nothing about the correlation of these tests, one with another 
we cannot say anything concerning the reading ability of these 
children other than that they stood low according to the Kansas 
standard and high according to the Thorndike standard. We did 
derive a great deal of satisfaction from the fact that the youngsters 
could read well according to Thorndike. 


> 
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rABLE I KANSAS SILENT READING TEST MEDIAN SCORI 


| 


\ 
VW KAD \ [ \ i ~ 
Mean Wi 
I] 4.75 ) 
49.5 10.6 i 19 6.2 6.1 17 
I\ 1 13.0 13.8 90 95 10.6 & 4 
\ l 16.3 15.4 13.4 14.6 14.4 12.3 
Vl 13.0 14.9 14.0 13.7 14.8 15.0 11 
VII d 13.5 17.9 16.1 17.7 18.0 15.4 
(4 
/ 17 20.6 19 


Even though our scores were high throughout, our tea 
were not satisfied with their teaching of reading. They art 
deavoring to learn the most scientific methods of teaching thi 
subject. Silent reading now gets more emphasis. This fa 
evidenced by the use made of lists of supplementary readers, t 
requisitions for new material, the increased use of the vari 
libraries, the call for much more new library material (both books 
and magazines), and the lists of outside reading posted and us 
in each grade room. 

Table III gives the median results for the Stone Reasoni 
Tests. These tests were corrected and graded by three peop 
In giving the tests, the teachers were especially careful to follo 
directions. The results obtained were the most gratifying of 
The scores no doubt demonstrate the reading ability of the pupils 
as well as their reasoning power. The median accuracy scores 
higher than the median reasoning scores of all the other cities ex 
cept those of Salt Lake City. The scores may indicate that in the 
study of arithmetic, too much emphasis has been placed upon this 
type of work. The results for the Courtis Standard Research 
Tests in Arithmetic, Series B, also suggest that perhaps too much 
time and emphasis are devoted to reasoning problems and not 
enough to habit formation in the four fundamentals. While th 
speed and accuracy scores are not the lowest within the lists of gr 
comparisons, they fall far short of the author's standards and the 
better work of some of the schools listed. Table IV shows the 
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iil. STONE REASONING TESTS MEDIAN SCORES 


AN \ \ 
| 
\ } 
11 ) 7 
é é 
6.» 10.8 58 60 
7 ) 10.5 {) ( »4 


. number of examples correct at Anoka and a comparison ot 
res with those obtained elsewhere and with Mr. Courtis’ 

Is. The comparisons for the number of examples 
ndicate about the same 


| and for the percent of accuracy 1 
lus that much 


position for Anoka. The results informe 
ergy, information, and teaching ability will be necessary 
¢ our schools up to standards set by other schools and by 
ds of ordinary life. As soon as the scores were reported 
chers began to call for all types of information upon teach 
| drilling fundamental facts in number work. Four sets o! 
iker Economy Practice Exercises in Arithmetic! were 
sed and are now used. The sixteenth and eighteenth year 
the National Society for the Study of Education were 


brought into service. Better teaching of the fundamentals 


product of a handwriting test was judged both for speed 


uality by means of the Gettysburg Edition of the Ayres 


rr writing Scale. The work was done by two teachers, the 
supervisor, and the teacher of commercial subjects. The 

of their scores was taken. As the median marks indicate 

eed of the pupils is high and the quality is low. The onl) 


we can find for this condition is not less attent 
attention to letter and word formation. By a study ol 
juality (Table V) we notice that there is no marked improve 
nt in ability to write more legibly until we reach the seventh 


erade. This grade as well as the eighth suddenly approach th 
standard in quality. The cause for such poor penmanship in the 
lhese are published by Scott, Foresman and Company. 


\ 4 . 
i 
i¢ 
{ 
resu 
rh 
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lower grades and such sudden improvement in the upper 

may be due to the writing method used. We feel that we wis! 

develop rapid writers rather than slower drawers. We h 

yet found a method whereby we can keep our speed and 

same time teach better quality. \\ 


TABLE IV. COURTIS STANDARD RESEARCH TESTS IN ARITHM 
SERIES B-—-RIGHTS 


ANOKA 
bos. | Inp SALT Col 
( | INI LAKE |BuTT! Ka 
= = |TROIT rON | IANA | 44 MBIA 
«= City 
Addition 
L\ 2 2 2 
\ 1.2) 3 3. 5.7 6.6 3.6 4.1 9 2.4 
VI $8) 49 $8) 7 4.4 6.4 2.9 ) 
VII 5 4 $5 75 9.0 49 6.9 3.8 3.9 } 
Vill 6 6 9.4 10.4 5.8 8.5 5.3 £.0 5.4 
Subtraction 
3.5) 4 3.7 
\ 7 6 6.5} 7.9 7.7 5 5.2 5.5 4 4 
VI 6.4 6.2 8.6 95 65 78 58 18 59 
Vil 8 7 7.5} 99 | 10.3 | 7.9 8.8 7.1 5.6 7 
VIL 12 12 12.5 11.8 8.9 9.8 9.8 5.4 wud 
Multiplication 
I\ 4 
\ 6.5 $ 5.2 5.8 5.6 43.9 3 41 3.4 31 
VI..| 54] 5.2} 7.2] 7.2] 5.1 | 50] 44 | 47 
Vil 5.8) 7 7.8 8.2 5.9 5.5 5.9 
VIII 4 4 93 7.3 8.3 8.1 46 3 
Division 
2 3 
V 5 3 } 1.6 1.9 2.6 3.0 3.6 2.5 2 
VI 4.2) 3 3.6 7.3] 74/48 | 55 | 43] 3.9 3.5 
ow 
Vil 4.6) 6 5.3} 9 8.8 6.7 7.7 7.2 
VIII 8.8 8.8} 11.7 11.0 9.1 9.5 10.2 5.5 8.3 


Language and composition ability were tested and scored by 
the Trabue Language Scales, Series B and C, and by the Nassau 
County Supplement to the Hillegas Scale. By the median scor 
in Tables VII and VIII it may be seen that the pupils 
stand high in language and composition writing abilities. The 


| 
| 
I] 
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tions were scored by four judges. Two of these were 
_the third was the superintendent, while the fourth was 
i from outside the system. The judgments were independ- 
Phe average of the four opinions was taken as the final score. 
\\ -ome differences in scores were found, there was a striking 
irity in the four sets of marks. 
vy. AYRES HANDWRITING SCALE “GETTYSBURG EDITION” 
MEDIAN QUALITY SCORES 
JRA 
Frank.) Wash-| Mean |CLEvE- |Kansas Iowa | Ayres] Gary 
lin ington LAND 
$1 5 44 39. / 357 
(50 
}33 30 31 47 42 39.8 4? 30) 
30 i S88 50 45.8 | 44.5 16 3 
\ 37 33 35 45 55 50.5 419 ] 50 34 
I 37 47 2 | 48 59 $4.5 | 52.3 | 54 36 
65 50 56.5 SO 64 58.9 57 
«50 38.5 55 70 62.8 61 6? 4)? 
R5 
LE VI. AYRES HANDWRITING SCALE—“GETTYSBURG EDITION” 
MEDIAN SPEED SCORES 
ANOKA 
Frank Wash- | Mean | Cieve- | KANSAs Iowa | Ayres] GARY 
lin ington | LAND | 
I 30 35 32.5 32 30.6 39.2 32 
29 
}42 | 42 | 385 | 35 | «43.8 | 49.2 | 44 18 
55 | 71.5 si. | (51.2 61.9 56 45 
\ 81 84 82.5 60 61 59.1 65.5 64 58 
I 72 R4 78 [ae 67 62.8 72.6 70 70 
82 SO 78 71 67.9 75 76 
I] 88 80 73 73 76.5 80 90) 
| 
iX 100 
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rABLI Vil PRABUI LANGUAGE SCALES, SERIES B AND 
\ \ 

Mi 75 
| 10 12 
12 11 13 
14 1s 
\ 1 18 
VI 22 21 25 
Vil 4.6 »3 26 
Vill 26.4 23 

IX 28.4 


rABLE VIII NASSAI COUNTY SUPPLEMENT TO THE Hl 
SCALI MEDIAN SCORES 


\ 
Ciry 
4 

I\ 5 29 34 
\ 3.45 31 »S7 
Vl 1.8 $.45 3.40 
ec 14 2 76 
\ 1 ] 5.4 4.11 


he measurement work above described has been very 
ficial to the teachers, supervisors, principals, and superinter 
Chis is proved by the fact that some of the teachers have as 
that during the present year two measurements be taken. | 
tirst sal ple s were taken in October. The second will be tak 
Apmil. We shall then be able to see how much improvement 
been made in the various subjects and grades. 

This study of the tests has been a great help to the scl 
system. It has acquainted the teachers with the measure! 
movement in education. It has helped them to discover in 
ual weaknesses in various pupils. It has made the faculty 
cognizant of individual differences. They are beginning to k 


best methods for teaching fundamentals; methods based not 
much upon a prieri reasoning as upon facts, results, and iny 
gations. 
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has been much professional growth on the part of th 


As a manifestation of their interest sixteen of the fore 
University of Minnesota extension course in ! 
This knowledge should bring further impr Vel nts in 
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SUBSTITUTING SMALL NUMBERS FOR LARGE ONES I\ 
THE COMPUTATION OF COEFFICIENTS O] 
CORRELATION 


LEONARD P. AYRES 


‘ l Sage Foundation 


Great economies of time and labor in the computati 
coefhcients of correlation may be effected through reducing 
magnitude of the numbers used, without changing the tre: 
the two series for which the coefficient is to be found. 1 
two very short series for illustrative purposes, we may sup 
that we desire to find the correlation between the following 


S R 
22 108 
23 110 
25 110 
26 113 
27 114 


In computing the correlation we are ascertaining the amour 
of agreement between the trends of the two series. These tre: 
are determined, not by the size of the numbers in each series 
by the amounts by which the larger numbers in each series ar 
excess over the smaller ones. Because of this, the trend of 
first, or subject series will be unchanged if we subtract 21 fr 
each item in it and the same will hold true for the second 
relative, series if we subtract 107 from each item. The two seri 
now become the following: 


R 
1 1 
2 3 
} 3 
5 6 
6 7 


The correlation computed from the smaller numbers is just 
same as that from the larger ones and the work is much easic! 
The rule to follow in most cases where it is desired to find t! 
coefficient of correlation between two listed series of paired values 
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by subtracting from each number of each series an 


that is smaller by one than the smallest number in the 


t tables of distribution, the values are stated by classes 


the original values. 


Salaries 


maller numbers. 

lhe computation of the coefficient of correlation from the data 
s example tabulated in its first form and with the service 
nd salary classes stated in full, gives as a result 


r=- 


he following instance: 


— 


2,400 


V 560,000 55.6 


In this case the scale of salaries runs by steps of $100 each and 
t of years by steps of 1 year each. The correlation should b« 
nputed from a table in which these steps have been substituted 


The table will be as follows: 


V 31,136,000 


It might be thought that the scale for salaries ought to be 
tered as 6. 7, 8, and 9 instead of as 1, 2, 3, and 4, but, as has 
lready been shown in the previous example of the listed pairs, 
the results will be the same in either case so it is better to use the 


| 
Salary Year f Service 
1to19 2 to 2.9 3 to 3.9 $to 4.9 
) 4 1 1 6 
' 1 5 2 10 
200 1 | 10 22 
0 { 4 7 10 22 
7 14 23 16 ov 
S R—Years 
| | 2 | Potal 
| | | 
1 Bel 1 6 
| 2/| 5s 2 10 
; | 7 | 10 | 4 22 
; 4 4 7 | 10 22 
Total | 7 14 23 «| «16 60 
2,400 2,400 0.43 
j 
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When the same operations are carried through with 1 || 

data tabulated in the simplified form with the classes stat 

a | 4 the result i | 
24 4 

0 434 
1 113 ¢ Ss 


While the coeffi it nt of corre lation is the Same in bot] 


must be noted that care must be taken in stating the me 
the coetlicients of regression This coefficient for the subje ; 
n derived from the original tabulations, is 2,400 ; 
560.000 
which indicates that on the average in this group the ir 
tend to ad i +3 of a year in service for each ads 
10.000 
dollar of salary, or 0.43 years in service for each $100 
tional \ 
If the corre S] onding coefficient of regression is derive 
the data of the simplitied tabulation it is - or 0.43 The 
SO 
ing of this is clear if we remember that the 56 in the fr 
derived from the subject series which gives data for salaric 
are in this case stated in terms of steps of $100 each. Thi S 
then indicates that for each $100 of increase in salar 
individuals tend to advance 0.43 of a year in service. Thi 
regression is — 0.43 and indicates that for each addit if 
55.6 
year of service they tend to advance 0.43 of $100 or $43 In 
Che foregoing paragraphs may be summarized in three si: tr 
tatements. The first is that in computing the coeffici th 
correlation from listed series of paired values the first st p is { Ww 
subtract from each item of each series a number that is smaller . 
one than the smallest number in the series. The second ru 
that in finding the coefficient of correlation from a table of dist ul 
bution the first step is to substitute for the two series of c! 
values, the numbers 1, 2, 3, 4, etc., being careful to omit any ! 6 
ber for which the corresponding class is missing in the origi re 
series The third rule is that in the interpretation of the cox 
ients of regression it must be remembered that the values are 
stated in terms of the class values or steps of the original ta! 


lation. 


— J 4 
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Editorials 


DR. AYRES’ FORMULA 


\ number of inquiries have been made as to the proof of the 
method of computing correlation coefficients which Dr 
\yres described in our March issue. The method is entirely rigor- 
thematically. Moreover it relates closely to methods al 

-eady known and used. 
-e who work with correlation tables are accustomed to 
averages for the subject and relative series. The devia- 
are worked out from these assumed averages, and the 
ections—i.e., the differences between the assumed and the 
averag are applied. What Dr. Ayres has done is, in 
ct. to assume an average at zero for both the subject and 
tive series. The correction or difference between the assumed 
and the true average then becomes the true average itself. 

Notice how this works out. The formula for the computation 

‘ the Pearson correlation coefficient when it is computed from an 
imed average may be written as: 
nc,2) 
In this formula c, is the correction to the assumed average for the 
ject series and c, is the similar correction for the relative series 
In other words, c, is the difference between the assumed and the 
true average for the subject series and c, is the difference between 
the assumed and the true average for ‘the relative series. Now 
when the assumed averages are taken to be zero, ¢, becomes the 
verage of the subject series and c, becomes the average of the 
lative series. Moreover x and y, being deviations of the meas- 
ures or items from zero, are the measures themselves. 

Substitute, therefore, in the above formula for Cy, A, and for 
c,, A, where A, and A, stand for the averages of the subject and 
relative series respectively. The formula then reads: 
zxy—nA,A, 


r= 


2) A 2) 
V(sx2—nAZ) (Sy*—nA,’) 
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Consider now 


A If this ion 1 ibstitute 
second term of the numerator i t numerator 
4] ] 
ind tne ws cancel Ol co sis very iciegant but 
rt to e cle LO Lhe ( ik W ¢ 
} +} 
now the items then \ Write 


rhis is the numerator of the formula as Dr. Ayres giv 


219 

Similar substitutions may be made for A, and A, in the d 
inator of (2 Making these substitutions and noti 
average times the number of items equals tI tal of the it 
obtain the denominator of the formula by Dr. Avr 

Thus his formula is an application of t isual fort 
case where the assumed average or point of reference is t 
zero. A more mathematical proof might begin by expri 


measure as the sum of the average of its series and its de 
from the average. Thus each m re becomes a binomial! 
] ] 1 


first term is the average of the series and whose second ter 


deviation of the measure from the average. In order to i 


usual [torn 


gate the identity of Dr. Ayres’ formula with t 
computing the correlation coefficient, it would next be n 
1) to form the products of the successive pairs of m 
as written in this binomial form; (2) to squar 

3 to 


binomials constituting the subject series: and ju 
successive binomials constituting the relative series. 


The first of these operations gives us a polynomial of fo 


for each pair of measures. For the first pair it would bi 


A 
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Gee the fact that, by the definition of an a ‘ 
Is 
e 
¢ 
OF cour \ bstituted for Int ise the numerat 
Ayre ld n of the produ of 1 su in 
items mu ‘ tr tems X tot. of sx items.”’ In ot r words, tl 
tion may con st of the produ t of the average of either series and the total of 1 
| 
| | 
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{ D,+d,D, where A, and A, have the same meanings 
and d,; and D, are the deviations of the first ject 
nd the first relative measure respectively. Summing 
ynomials of this type, we obtain nA,A A 3d+A,2D- 
y Observe. however, that since the sum of the deviations 
in average must be zero, the second and third terms of the 
ression disappear. Observe also that 2dD is the same a 
yy of the usual formula. Evidently, therefore, if we deduct 
om this expression, we have the =xy which we recogni 
numerator of the Pearson formula. Since nA, equals th 
the relative items, #A,A, is “Av. of subject items X tot 
ive items.” 
rly, the second and third of the operations mentioned 
ive a series of polynomials of three terms. Their summa 
yield expressions of the following type (using the notation 
ubje ct series) nA/+2A,=d Here again, since the 
tion of deviations is zero, the middle term vanishes. 
the usual The reduction must, therefore, be 
{ (wA.). or “av. & total of sub. items.’ Hence the first quan 
nder the radical in the denominator of the Ayres’ formula 
es to be the same as the first quantity under the radical in the 
inator of the usual Pearsonian formula. The second quan 
proves out in exactly the same way. 
{yres’ formula will therefore yield the same results as 
usual Pearson formula, and workers are justified in using it 
ny advantages which it may have. 
B. R. B. 
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Reviews and Abstracts 


| \ nl ndar Os 
Nor 1919. 170 py 
n investigation carried o 
| N H t Brown was D tor of the | 
DD t Public Instruction itstate. 7 
1 upon t mport 
gh r I 
ta | l ng tl thor \ 
P r ( Madison, Wisco 
, f Latin the children had obta i 
I] I ithor | ves that the schools are equal 
of nd that the tion as fo n tl essentiall 
\ n r’s st of Latin, only or lf of the ] 
t ] i as rumen r ri \ 
half of the s were able to translate a 
D min quo Han t dtos exitus | r 
ent test, altl wuthor supposed that it would prove too easy for 
‘ | y don t mtrar to be too d It I 
t that re} nted tl r ones in beginners | 
f med t pupils were rcely able to translate tw 
t tences, second-year pupils less than four, thi ear pupils | 
I puy a little over six. The product, therefore, of 
instructior s the ability to translate six out of twenty sentences repre 
ea rcises ginners Latin bool Since the pupils were given pra 
the time they needed, this may be understood to be their best effort 
The i ution might have stopped here. Corroborative eviden 
W 1 by administering a “connected Latin test,” a grammar t 
\ ry test. Good scores were obtained only in the vocabulary test; but t 
he of its extremely simple character. The five most difficult words 
muy sisquam, copia, and pax 
\pparently, therefore, each of the tests tells the same depressing story. | 
idle to indulge in arguments as to the “value of Latin” when the evidence is 
to t effect that children do not learn Latin. The battle of the classicists 
scientists or 1 ts or whoever they are who attack the study of the ancient t 
suddenly becomes a battle of kites and crows. The issue seems to be of no con 


and the victory not worth fighting for. If Mr. Brown’s results are typical, onl) 
few boys and girls are getting enough Latin to do them any good no matter w 


disciplinary, cultural, or linguistic values may be, 
B. R. B 
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iete inte ition tional? rey nt 
ts may result in tl reatest } 
: rs in the bul n, three by ( rel t 
mmatical errors and to scient co 
\ Press nd others relate test nce, t Ashi 
t | service in lo nd to recent velopr n Ss} 
nex eps in ed tior rements 
s out the present cc les are unar land he 
| 
i 
| 
Scale rer nd e descril 
i 
rrelation with t« cher s rar i 


t No at bt na 
the ent tact to all nts in 
sel tated hools of tl ti Next to the t t rmy t 
hensive tempt at intelligence measurement record 1 and its re 
vith interest 
( + S. Carney, consultant with a firm of industrial engineers, at B 
M tts, reports ex™ riments with ment il tests a na n t elecuiol 


f clerical workers in a large factor \ variety of intelligence test 


t on time clerks, but yielded unsatisfactory results \ job analysis « 
tasks was then resorted to and tests modified or constructed \ 


if be diagnostic of ability in these tasks. Mr. Carney concludes that 


that purpose; and that, while for } purj general er 
lue, they are increasingly useful h reference to the! respx 
Vhile personality is not m urable by test but r t be g | 
emplover who has once been so fortunate to nd , 
et ol test will never agau be satisfied to pict men t pl 
yns of an interview alon 
Charters. in discussing scientific curriculum construction, attributes the d 
tion with the curriculums of the school as not fitting the needs of modert 
e factors: first, the umption that the best method of equipping for l 
nt young pt yple with the org nize 1 fields of knowl lge accord t th 
rrangement of each: second, the failure to analyze the aims of ¢ tior 
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= 
ren n educational measure? Bulletin of the I yn Division, 
University, v. 5, no. 1, September, 1919.) I gton, Indiana 
D n, Indiana Univ ty, 1919 
| eld by the School of Ed tion of Indiana wait 
J a -; Monroe. at that time director of the Bureau of ( : 
not 
i} 
| | 
nol 
Mental 
in 
ind 
] 
letermir nd third, the fail of 
objectives sufficiently detailed have been determined, and thira, tl 
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tas 
( that 
f edu 
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t f ‘ \ 
n e been le 
Oj th of | 
M briel re tl pr re il 
r ee | 1 le t 
nd « ) nterpre 
il lor t 
t Ork 1 ng This 
‘ g list 2) the method of t 
t " test The selection of words on th 
l rded best of tl ethod 
t r t that t 1 of teaching 
t t i learnit In meas g result 
I but lual words and indi 
W Wittram A ] me? f chi \ 
B | Brown d ¢ 1919. 193 pp. 
I little lox taim top nt an exhaust in 
I f ran attempt to put in popular for 
f value ir tr ing of n 
be of especial n this connec 
t t famil conclusion con 
tr t held of ns s possessed of a devel 
toitsinfancy. T conclu ring t 
t f that ti n commonly held, 1 
I part ¢ t il erta 
I tion of all nduct is desire growing out of ‘ 
the two { ntal tinct lf-preservation and sex 
t tant att s to control the environment, physical 
feel t ly ferior in the struggle for dominance will 
lt eling ppre m by special endeavor in some 
t l erior ] ex instinct frustrated by social « iit 
lead to all sorts of dangerous substitute reac 


subl 


tions. On the other hand, if p1 
mated” they may become the motive for the highest type of hum 
ich as art and other creative tendencies. 
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Seasnore, Cart Exit. The psycl mu nt. Boston: Silver, I 
( 1919, 288 pp 
2 
I nt nm ge for two cl f persons, tl 
I f the teacher or supervisor of music in publ | ] 
ry the work of the author and of his 
ut [ itory of the State Univ of I 
hic! devot ! to the study of the psychology of musi I 
ll give scientif nformation concerning musical talent that has definit 
ilues 

Professor S re | I d the capacity r ed for learning t 
musi It I ory of t 
bases of cl I the att ites of sound (pit I 
tion, and « nsit nd 1, t e traits of the human mind w harer 
the ay nd expression « ognized attributes of sour 
tone ol tor t representation of tones in memory) r 
n thought, and mu l feeling). Asa result of nalysis 25 “‘m 
are | i 

\s e re It [a tudy of the ps chology of music, the hor } 

labl ! I r the grouy surement of six sical taler 1 
pit 2 e of inter 3) sense of tim 4) sense of consonance; (5 
memory; and (6) musical imagery. Each of the tests may be given to a 
pupils in a half-hour period. The author recommends their use in the fifth gr 
preliminary survey and again in the eighth grade in order to advise pupils 
ing the avocational and vocational pursuit of music. 

Poss n of these talents is a prerequisite for certain types of musical 
ment. Sir for the most part, they represent native equipment rather t 
results of training, measures of them in connection with other informatiot 
very reliable basis for the vocational and avocational guidance of school 
Ihe furnishing of a basis for such guidance rather than the measurement of 
ability or of the results of teaching is the real function of the tests 

The volun a very important contribution in the field of applied ps) 


Concisely stated paragraph headings materially assist the reader. Portion 
ir to be well balanced because of the brevity 
nht 


tain topics and the elaboration of others. This is no doubt due in } 


pM 


t] ndeveloped character of the field 

In geners! the book is weak in the presentation of data, but strong in keenr 
analy nd interpretation. The graphical charts are below present-day stand 
Practically n of them can be read without looking up the notation in the text, ar 
many Cases it is necessary to turn to another chapter to get this information 

It eldom that a fundamental treatise, such as this volume is, fails to inclu 
carefully prepared bibliography This book contains no bibliography and _ thi 
note references are frequently of the “‘op. cit.” type. Neither is there an index. 1 
elaborate topical table of contents partially takes the place of this but not enti 


rhe responsibility for these defects and the one concerning the graphical charts 


be shared by the editor and publisher of the book. It is announced as the s 


volume of the Beverly Educational Series and it is hoped that such defects will be 


inated from future volumes. 


W. S. M. 
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News Items and Communications 


This department will contain news items regarding research workers 

their activities. It will also serve as a clearing house for more formal 

nications on similar topics, preferably of not more than five | red 
cations will be printed over the signatur: f 


irtment to Walter 


ds. These commun 
rs. Address all correspondence concerning thi 
Monroe, University of Illinois, Urbana, Lllinois. 


) r Chas. I Harlan of the Lurea { |] 1 Te Standar 
Measure ents writ that he has return a tour 
Idaho Bureau e state of I in ea lated, 
at Lewiston interpreted both « ( ‘ 
ind to more than twenty t i t é 
St Xeasoning Test \rithme ( rd j 
Series | Diagnostic Tests Language 14, r, \rit 
Scales, Haggerty Intell! e kxaminat S d the Otis ( Inte ence Test 
At the recent meeting of the Department of Superintendence at Cleveland new 
( iti ma organi tion is lar il the 
Directors of National Association of Directors of Supervised $ lea 
Supervised ing rhe r e of the organization is expressed as follows in 
Student Teaching the prelin inary announcement 
“The dominant purpose of the associatio ll be to test 
g school the principles of psychology and education taught e profe 
rses offered in the training department of the institution, with the vi 
instruction as will not stand the test rhis will 
omplete ur r, harmonizing, and simplifying of the le eme of 
er ed student teachiz 
rhe Southern California Educational Research Association was organized in 
7ecel er 1920. Its purpose is stat las follows: “(1 lo dis the value and 
standardized tests and statistical measurement 2) To constru 
Southern tests and measurements as the need arises these to become the 
California erty of the Association and not for private gain; (3) The study of 
Research other phases of Educational Research as may be desired by the A 


(Association ciation.” 


President; Dr. A. H. Sutherland, 


reasurer. A charter membership of forty-t 


It was decided to hold meetings every two months in Los Angel 
1: Dr. W. Franklin Jone 


Vice-President; Miss Mary Bess Henry, S 


| the following officers for the 
hree seemed very encouraging for th« 


ure of the association. 
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1 Vict t material 
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rds fr 1 the Ayres spe ng list The second 
t It « sists of 24 line n each of I t 
es, U suntrel winter bol omutst 
c vord and draw a line around it rhe thir 
il addition combinations and n tl 
exact iar to tests A al 
e last page is a test of the understandi i 
4 <t y tainme f puy 
7-74, M 
easuring rithmetik Journ Edu 
t written by sc hildren, selected from 
by 30 to 70. The 1s 
told tor er the wder of value. The score 
¢ work tne pudlt pp 95-96 
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Mr. | t Brat Director of Research at Long Beach, spoke at the J 
t I De tment of Research ina Lit M 
ter the ri ilts of intelligence and « 
ty thy | 
M t r. J. Harold Williams, Director of Resear t 
[ meeting of the vear be in charge of Dr. A. H. Sutherla I 
t the | \y City $ vill speak on some important ada 
linica t Los Ange! ools 
Phe t it ry ils ors v0] tems by means of standardized 
i t ol ciency.” Relative tli is thus far 
‘ e | enient for roups 
irve iperint 
ord uriety of sources; 
que rying order. The 
] extensive survey, 
» batteries of standardized t 
2) an examination ior the s 
msists of four tests, on 
rican history, the questiot 
The second page consists { 
se in grades six to eight Ont 
the que stions being selected fr 
why Scale. The fourth is a test of English.* The s 
h of the four “promotion subjects.” ve 
h tect 
| 
1 terms ol 
tion ‘ t order 
‘Judd, C.H. Measuring 
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} es, each consisting ol a sentence t 
g ind down The « listocr t the 
itteries ol tests have et t 
I ee Indiana Lik i 
‘ ed is ‘ 
r An tati nd com t 
i ent tota or 1umer il 
1 I 4 ta ne 1 lor 
tions are designed primar for s surve 
ceived the iS parti irl us | 
a ive an ins Ol meas ing not merei 
ittal ent asa hole ind the ould thu iK¢ 
the edu ynal status of each child, in a much larg: 
in we ther Poss ik 2 It ld 
t g, as a whole 3) Finally, by the combined use« 
telligence it should be possible to set over against each « 
evement t aluate it a child has d 
adit iriv it e to ¢ 
rd to the quality of “pupil material” with v 
re a minimum standard which we have a right to set 
( I of the | ted States? Should a tea er 
all the geography from first grade thr 
The Scores of a able to locate any state of the | ont 
Group of Rural be able to tell the state in w the thirt 
Teachers on Courtis country are located, not by r tl 
Standard Supervisory a number opposite the name of the cit 
Test in Geography on the state in which tl t pens t 
Without att ting to a r the 
to g e tne results of i test of the perior lance ola vr ) 

t rs in an Iowa county which I must not call typical. It 
ns a teacher training institution, and |} n its bord 
ul citic Middle West, as well as another good si 

pe a county is not, of course, typical of I 
Stan visory Test in Geography wa it 
rs ere not asked to sign the papers | t x 
t tion of the ty-eight states the re 3 were 
f tates locates rrectly is 40, the extreme variat t 
eriect ores. ol ich there ere twe Ut the t tal 
2 graded between 10 and 14 
5 15 19 
10 20 24 
<= ”) 
7 ” 34 
11 35 39 
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ght papers were unfinished With these, all states after the | 
not counted “‘omitted.”” The District of Columbia is 
ted oided by 32 writer It was misnumbers 
é the District in either Maryland or \ 
H i r placed Washington in lowa And 
t n I 1.) 
Delaware is the most puzzling Will o’ the wisp. It was omitt 
issed 28 It seems to be confused with New Jersey very trequt 
l r take 1 the placiz of New Jersey vhich 1S sé 
0) error \ ther eastern state, New Hampshire, shares t 
nd Kansas, each with 28 errors. New Hampshire is often inter 
: there were 25 mistakes 
nto detail as to number of errors with other states. There wer 
more, while 11 were missed 10 times or less. California, Mair 
each missed by one teacher. lowa, strange to say, was misnur 


States contiguous to lowa stand low in the scale of errors, Min: 


in th 8, Illinois with 2, Missouri with 14, Nebraska with 14 


that with some states there is ease in remembering “‘outstand 


thing to fasten to.’’ Witness California, Maine, Florida, each miss 


tall. Rhode Island was misnumbered 22 times 
the errors of teachers seem to fall into two comparatively ea 
asses; first, the interchange of poorly oriented outlines, as Ver: 


hire; Connecticut and Massachusetts; Washington and Or 


\rizona; New Jersey and Delaware; second “random shots 


kes’’—to use a term from athletics. There is often indication that t 


1 as to location, making a mere guess at it; while in other cass 
der a mistaken impression, perhaps judging more by shape t 
cities, Washington is most often misplaced or omitted, having 

her Many of these errors are due to placing the capital 


shows a knowledge of its whereabouts, but not an accurate 


nd, with 35 errors, and Duluth third with 32. No teacher 1 


San Francisco; all other cities were misplaced or omitted by at lea 


cations of cities sometimes correlate with errors in states, and s 


stance, one teacher gives Kansas the number properly belonging 


ikely to place opposite to Kansas City the Nebraska number wi! 


it of Kansas. Many writers placed Rochester in Minnesota. T! 
great hospital at that point has given the Minnesota Rochester 
that of the larger city of New York, and superior to it in t 

nge to say, some people make mistakes in numbering a state, 

) a city within that state, get it correct. 
ities were as follows, in groups of 2: 

2scored 7or 8 

9 or 10 


1 ” Alor12 


5 ” 13or14 
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Does this not challenge 
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la ect this, a there be shown a fairly hich positive [ 
ed easuru tor ila t 
{ 165 \r there 
eri the twe erent ective wt 


\\ 
r ed the exa t Lik 
t t t t ir as tea istory is 
pore 1 and i ( tear ers i 
tt t how capable the pupus pr il 


t ir i ina: the ledera 
ct lit. The D cratic party until recent! 
r t \ i und re ins untii recen ere | ed tot 
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H the ure furnished gratuitously I 
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| () t ( Lin 1608 id chanced to 
NI | What 1 pr 1 have been the results of t N ’ 
| 1758 
( text— Woo rn and Moran, Forman, Hart, Fite, a 
exa Can it not tau 
t (1 < re YO percent I 2) some call for “‘t 
, ete tor 3) others de ind thinkir \ 
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Do t facts that he selects have ‘“‘a nece ry reterence to histor dee 


Fr ' I persist in my innocent faith that a job is looking for a t 
and that it ould be verv unsatisfactory to test for facts only and cont t : 
” bjective nference of problematic symptoms, the capabilities of | 

to achieve the gher abilities” that good history teachers desire for them 
F. S. Camp 
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